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Ten  Propositions  About  Prediction  and  National  Security 

HUMANITY  IS  COMPELLED  TO  PREDICT  AND  WILL  FAIL  - 
THE  FIRST  FIVE  PROPOSITIONS 

1 .  The  Propensity  to  Make  Predictions  -  and  to  Act  on  the  Basis  of 
Predictions  -  Is  Inherently  Human. 

2.  Requirements  for  Prediction  Will  Consistently  Exceed  the  Ability 
to  Predict. 

3.  The  Propensity  for  Prediction  Is  Especially  Deeply  Embedded  in 
the  U.S.  Department  of  Defense. 

4.  The  Unpredictability  of  Long-term  National  Security  Challenges 
Will  Always  Confound  the  Irresistible  Forces  That  Drive  Prediction. 

5.  Planning  Across  a  Range  of  Scenarios  Is  Good  Practice  but  Will 
Not  Prevent  Predictive  Failure. 


HOW  TO  PREPARE  FOR  PREDICTIVE  FAILURE  - 
THE  LAST  FIVE  PROPOSITIONS 

6.  Accelerate  Tempo  -  and  Delay  Some  Decisions. 

7.  Increase  the  Agility  of  Production  Processes. 

8.  Prioritize  Equipment  That  Is  Most  Adaptable. 

9.  Build  More  for  the  Short  Term. 

10.  Nurture  Diversity;  Create  Competition. 
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EXECUTIVE  SUMMARY 


By  Richard  Danzig 


The  U.S.  military  relies  on  prediction  to  fore¬ 
cast  needs  and  influence  the  design  of  major 
equipment.  A  future  or  futures  are  envisioned, 
requirements  are  deduced  and  acquisition  and 
design  decisions  are  made  and  justified  accord¬ 
ingly.  However,  both  the  experience  of  the 
Department  of  Defense  (DOD)  and  social  science 
literature  demonstrate  that  long-term  predic¬ 
tions  are  consistently  mistaken.  The  acceleration, 
proliferation  and  diversification  of  technical  and 
political  changes  make  21st-century  security  risks 
even  more  unpredictable  than  those  of  the  past. 

Thus,  whereas  some  efforts  to  predict  the  future 
are  necessary  and  predictive  techniques  can  be 
improved,  acquisition  programs  should  reflect  the 
likelihood  of  predictive  failure.  The  defense  com¬ 
munity  should  prepare  to  be  unprepared. 

The  report  presents  10  propositions  regarding  pre¬ 
diction.  The  first  five  are  descriptive: 

•  The  propensity  to  make  predictions  -  and  to  act 
on  the  basis  of  predictions  -  is  inherently  human. 

•  Requirements  for  prediction  will  consistently 
exceed  the  ability  to  predict. 

•  The  propensity  for  prediction  is  especially  deeply 
embedded  at  the  highest  levels  of  DOD. 

•  The  unpredictability  of  long-term  national  secu¬ 
rity  challenges  is  an  immovable  object.  It  will 
repeatedly  confound  the  irresistible  forces  that 
drive  prediction. 

•  Planning  across  a  range  of  scenarios  is  good 
practice  but  will  not  prevent  predictive  failure. 

The  second  five  propositions  are  prescriptive.  They 
show  how,  even  as  they  strive  to  improve  their  fore¬ 
sight,  policymakers  can  better  design  processes, 
programs  and  equipment  to  account  for  the  likeli¬ 
hood  of  predictive  failure.  Doing  so  will  involve 
several  actions: 

•  Accelerating  decision  tempo  and  delaying 
some  decisions.  In  a  world  characterized  by 
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unpredictability  and  increasingly  frequent  sur¬ 
prise,  there  are  heavy  penalties  for  ponderous 
decisionmaking  and  slow  execution.  The  U.S. 
government  is  now  designing  and  producing 
equipment  on  political  and  technological  prem¬ 
ises  that  are  outdated  by  the  time  the  equipment 
reaches  the  field.  To  counter  this,  military  depart¬ 
ments  must  dramatically  narrow  the  time  between 
the  initiation  of  a  concept  and  its  realization. 
Programs  must  also  be  designed  to  defer  some 
decisions  into  the  later  stages  of  development. 

•  Increasing  the  agility  of  our  production  pro¬ 
cesses.  A  21st-century  DOD  must  invest  in 
capabilities  to  respond  rapidly  to  unanticipated 
needs.  Accordingly,  ponderous  defense  manu¬ 
facturing  systems  must  be  redesigned  for  agility, 
using  adaptive  manufacturing  techniques  that 
generate  the  ability  to  switch  products  and  mod¬ 
ify  models  quickly  as  new  circumstances  arise. 

•  Prioritizing  adaptability.  In  the  face  of  unpre¬ 
dictability,  future  military  equipment  should 
be  adaptable  and  resilient  rather  than  narrowly 
defined  for  niche  requirements.  To  achieve  this,  the 
requirements  process  should  be  modified  to  place  a 
premium  on  operational  flexibility.  New  criteria  of 
this  kind  will  require  new  metrics  of  merit. 

•  Building  more  for  the  short  term.  Major  acquisi¬ 
tions  are  now  built  for  long-term  use  but  would 
benefit  from  greater  recognition  of  the  unpredict¬ 
ability  of  technology  development  and  combat 
environments.  The  defense  community  should 
seek  to  acquire  more  equipment  for  the  short 
term,  as  is  done  in  the  consumer  environment. 

•  Nurturing  diversity  and  creating  competi¬ 
tion.  Currently,  the  centralization  of  planning 
and  acquisition,  combined  with  an  emphasis 
on  efficiency  and  an  avoidance  of  redundancy, 
stifle  competition  and  technological  diversity. 

The  reality  of  unpredictability  suggests  another 
approach.  Competition  and  diversity  produce 

a  valuable  range  of  potential  responses  when 
unpredicted  challenges  and  difficulties  arise. 
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I.  INTRODUCTION 

Prediction  lies  at  the  root  of  all  strategic  think¬ 
ing.  Indeed,  it  underlies  most  everyday  decisions. 
People  stop  at  red  lights  and  proceed  on  green 
because  they  can  predict  consequences  associ¬ 
ated  with  these  signals.  However,  whereas  routine, 
short-term  predictions  are  generally  right,  strategic 
judgments  about  future  environments  are  often, 
one  might  say  predictably,  wrong.  The  common 
response  to  this  shortcoming  is  to  try  to  improve 
predictive  capabilities. 

I  propose  a  different  tack,  namely  that  long-term 
strategies  should  be  built  not  on  “visions”  of  the 
future  but  instead  on  the  premise  that  longer  term 
predictions  (that  is,  forecasts  of  situations  years 
and  decades  out),  however  presently  credible,  will 
probably  prove  wrong.  I  attempt  here  to  show  that 
this  premise  is  not  sterile  or  disabling  and  instead 
point  to  five  complementary  strategies  that  will 
better  prepare  the  defense  community  for  what 
cannot  be  foreseen. 

Two  cases  are  illustrative.  In  recent  decades,  the 
Department  of  Defense  designed  armored  vehicles 
for  particular  predicted  circumstances  (involv¬ 
ing  fighting  the  Soviet  Union)3  but  then  had  to 
use  them  in  unforeseen  contexts  (for  example,  in 
Iraq  and  Afghanistan).  These  unexpected  contexts 
changed  the  demands  on  these  vehicles.  Relatively 
simple  adjustments  could  meet  some  of  these 
demands  (for  example,  mismatched  camouflage). 
For  other  demands,  DOD  was  serendipitously  well 
prepared.4  Still  other  demands  were  difficult  to 
meet  and  led  to  vulnerabilities.  For  example,  the 
Abrams  tank5  suffered  from  high  fuel  consumption 
in  an  environment  with  inadequate  infrastruc¬ 
ture  for  delivering  fuel.  The  tanks,  and  especially 
armored  personnel  carriers,  were  particularly  vul¬ 
nerable  to  “improvised  explosive  devices”  (IEDs) 
embedded  on  roads.6  The  reality  of  unpredict¬ 
ability  raises  a  central  question:  How  do  engineers 
design  a  tank  or  other  armored  vehicle  if  they 


“[' T]he  test  of  a  first-rate  intelligence  is 
the  ability  to  hold  two  opposed  ideas 
in  the  mind  at  the  same  time,  and  still 
retain  the  ability  to  function.” 

F.  Scott  Fitzgerald,  “The  Crack-Up”  (1936)1 

“My  sole  advantage  in  life  is  that  I 
know  some  of  my  weaknesses.” 

Nassim  Nicholas  Taleb,  Fooled  by  Randomness 

(2005)2 

know  that  they  do  not  know  where,  under  what 
circumstances  and  how  it  will  be  used? 

A  second  case  derives  from  observing  that  systems 
to  detect  biological  attack  now  depend  on  designat¬ 
ing  a  short  list  of  pathogens  as  “threat  agents”7  and 
developing  methods  to  detect  these  pathogens  in 
the  air.  However,  revolutionary  developments  in 
biotechnology  empower  attackers  to  modify  patho¬ 
gens  or  to  create  entirely  new  ones.8  This  raises  the 
question:  How  do  researchers  design  a  detection 
system  if  they  know  that  they  do  not  know  what 
needs  to  be  detected? 

Although  the  following  discussion  is  grounded  in 
these  cases  and  the  institutional  context  of  DOD, 
the  arguments  in  this  report  are  more  broadly 
applicable.  The  implications  should  be  apparent, 
for  example,  for  the  way  DOD  recruits  and  trains 
personnel,9  locates  bases,  apportions  its  funds, 
plans  cyber  defenses,  etc.  (To  take  the  last  example 
as  illustrative,  software  generations  and  planning 
horizons  are  commonly  conceived  in  18-month 
cycles,  and  experts  regard  evolution  over  5  to  10 
years  as  generally  unpredictable.  How  should 
the  government  design  its  processes,  structures, 
defenses  and  training  in  the  face  of  such  uncer¬ 
tainty?)  Beyond  this,  I  hope  that  the  suggested 
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strategies  will  be  useful  to  commercial  entities  and 
other  governmental  organizations  that  engage  in 
capital  investment  and  long-term  planning. 

The  Challenge  of  Prediction 

DOD  is  required  by  law  to  produce,  every  four 
years,  a  20 -year  forecast  of  the  security  environ¬ 
ment  and  DOD’s  planned  responses.10  Enormous 
effort  goes  into  this  Quadrennial  Defense  Review 
(QDR).  It  is,  however,  merely  the  largest  and  most 
visible  of  a  vast  array  of  predictive  efforts  spawned 
every  day  in  every  government  and  business  all 
over  the  globe.11 

Paradoxically,  the  best  of  these  efforts  also 
decries,  if  incidentally,  the  ability  to  predict. 

The  Joint  Forces  Command’s  “Joint  Operating 
Environment,”  published  at  the  time  of  the  2010 
QDR,  observes  that  “[t]he  interplay  of  economic 
trends,  vastly  different  cultures  and  historical 
experiences,  and  the  idiosyncrasies  of  leaders, 
among  a  host  of  other  factors,  provide  such  com¬ 
plexity  in  their  interactions  as  to  make  prediction 
impossible.”12  The  document  buttresses  this  point 
by  summarizing  strategic  perspectives  at  different 
points  throughout  the  20th  century.  It  starts,  for 
example: 

1900:  If  you  are  a  strategic  analyst  for  the  world’s 
leading  power,  you  are  British,  looking  warily  at 
Britain’s  age-old  enemy,  France. 

1910:  You  are  now  allied  with  France,  and  the 
enemy  is  now  Germany. 

1920:  Britain  and  its  allies  have  won  World  War 
I,  but  now  the  British  find  themselves  engaged 
in  a  naval  race  with  its  [sic]  former  allies,  the 
United  States  and  Japan. 

The  Joint  Forces  Command  also  quotes  Winston 
Churchill,  saying  that  he  “caught  those  complexi¬ 
ties  best  in  his  masterful  history  of  World  War  I”: 

One  rises  from  the  study  of  the  causes  of 
the  Great  War  with  a  prevailing  sense  of  the 


defective  control  of  individuals  upon  world 
fortunes.  It  has  been  well  said,  “there  is  always 
more  error  than  design  in  human  affairs.”  The 
limited  minds  of  the  ablest  men,  their  disputed 
authority,  the  climate  of  opinion  in  which  they 
dwell,  their  transient  and  partial  contributions 
to  the  mighty  problem,  that  problem  itself  so  far 
beyond  their  compass,  so  vast  in  scale  and  detail, 
so  changing  in  its  aspects  -  all  this  must  surely 
be  considered...13 

These  two  strands  -  the  compulsion  to  predict  and 
the  recognition  of  the  inadequacies  of  prediction  - 
are  not  reconciled.  Typically,  predictive  documents 
either  ignore  the  problem  or  assert  that  their  own 
methods  and  abilities  are  so  improved  as  to  war¬ 
rant  proceeding  with  prediction.  The  Joint  Forces 
Command  document  is  better  than  most:  It  at  least 
emphasizes  the  problem.  However,  the  authors 
then  turn  away  from  the  issue,  offering  the  bro¬ 
mide  that  forces  must  be  “adaptable,”  and  proceed 
to  offer  their  views  of  the  future.14 

In  this  report,  I  accept  that  the  inclination  to 
predict  is  deeply  embedded  in  U.S.  institutions 
and  in  human  nature,  hike  others,  I  favor  efforts 
to  improve  capabilities  for  foresight,  and  I  agree 
with  the  best  thinkers  in  recognizing  that  fore¬ 
sight  is  not  the  same  as  prediction.  Prediction 
implies  an  ability  to  discern  a  particular  turn  of 
events.  Foresight  identifies  key  variables  and  a 
range  of  alternatives  that  might  better  prepare  for 
the  future.  Yet  my  concern  here  is  not  to  abet  this 
admirable  effort  but  instead  to  recognize  and  cope 
with  its  limits. 

In  my  view,  long-term  national  security  plan¬ 
ning,  such  as  that  required  for  designing  tanks 
or  biological  detection  systems,  will  inevitably  be 
conducted  in  conditions  that  planners  describe  as 
“deep”  or  “high”  uncertainty,  and  in  these  condi¬ 
tions,  foresight  will  repeatedly  fail.  However  much 
the  defense  community  continues  to  attempt  to 
improve  its  predictive  powers,  it  must  nonetheless 


grapple  with  the  problem  of  how  to  design  equip¬ 
ment  for  circumstances  that  are  not  foreseen. 
Predicting  the  future  may  be  “an  inescapable  task 
for  decisionmakers,”  but  it  is  not  the  only  task  and 
it  is  wrong  to  plan  solely  on  predictive  premises. 
Planners  need  to  complement  their  efforts  at  fore¬ 
sight  with  thinking  and  actions  that  account  for 
the  high  probability  of  predictive  failure. 

This  kind  of  planning  occurs  rarely  in  national 
security  forums.15  The  present  processes  result 
in  pounds  of  prediction  but  barely  ounces  of 
investment  in  considering  how  best  to  position 
the  nation  to  deal  with  these  failures.  This  report 
attempts  to  right  that  balance. 

Ten  Propositions  on  Prediction 

I  organize  this  discussion  around  10  proposi¬ 
tions.  The  first  five  describe  why  predictions  are 
invaluable  and  why  long-term  predictions  about 
complex  matters  such  as  national  security  are 
likely  to  fail.  In  the  first  proposition,  I  explain  why 
humanity  has  such  a  hunger  for  prediction.  In  the 
second,  I  argue  that  people  will  repeatedly  exceed 
their  predictive  capacities,  no  matter  how  much 
those  capacities  are  strengthened  or  how  often 
people  remind  themselves  that  humans  are  poor 
predictors.  They  will  always  drive  beyond  their 
headlights.  In  the  third  proposition,  I  argue  that 
the  hunger  for  prediction  is  particularly  pro¬ 
nounced  and  inbred  in  bureaucratic  and  military 
organizations.  Accordingly,  it  is  hardly  surpris¬ 
ing  that  the  world’s  most  successful  military 
and  largest  bureaucracy,  the  U.S.  Department  of 
Defense,  relies  on  prediction  in  its  decisionmaking 
processes.  Unfortunately,  historical  and  institu¬ 
tional  factors  have  intensified  this  dependency. 

In  the  fourth  proposition,  I  identify  the  variables 
that  I  think  most  confound  planners’  predictive 
capabilities  and  suggest  that  these  will  endure  in 
the  national  security  arena  and  result  in  ongoing 
poor  predictions.  In  the  fifth  proposition,  I  note 
the  value  of  moving  from  point  prediction  to  the 
consideration  of  a  range  of  scenarios.  However, 


I  emphasize  the  limits  of  this  approach  and  the 
enduring  need  for  strategies  that  embrace  and  bet¬ 
ter  account  for  unpredictability. 

The  second  half  of  this  report  attempts  to  show 
how  -  while  continuing  to  improve  foresight  -  the 
defense  community  should  also  design  processes, 
programs  and  equipment  on  the  premise  that  pre¬ 
dictions  will  often  be  incorrect.  While  trying  better 
to  illuminate  the  road,  analysts  should  recognize 
that  sudden  twists  and  turns  in  areas  of  darkness 
demand  special  driving  techniques.  Propositions 
6  through  10  propose  strategies  for  improve¬ 
ment.  The  sixth  proposition  argues  that  present 
defense  decision  processes  deliberate  and  design 
for  environments  that  are  changing  faster  than 
the  pace  of  the  deliberation.  These  decisionmak¬ 
ing  systems  need  to  be  modified  and  accelerated; 
otherwise,  evaluations  intended  as  a  means  of  risk 
reduction  will  actually  increase  risk.  In  addition, 
a  complementary  ultra-rapid  procurement  system 
should  be  developed  to  meet  urgent  requirements 
on  the  battlefield  or  elsewhere.  At  the  same  time, 
paradoxically,  some  decisions  should  be  delayed 
to  move  them  further  along  in  the  evolution  of 
environments  that  cannot  be  foreseen.  The  sev¬ 
enth  proposition  points  out  that  present  defense 
investments  for  standby  manufacturing  capabili¬ 
ties  focus  on  surge  production  of  present  systems. 
This  proposition  asserts  that  greater  priority  should 
be  given  to  making  manufacturing  processes 
more  agile  and  capable  of  meeting  unanticipated 
requirements.  The  discussion  outlines  a  path  for 
achieving  this  result. 

The  eighth  proposition  asserts  that,  even  if  the  pre¬ 
vious  recommendations  are  implemented,  aspects 
of  the  world  will  change  unpredictably  and  faster 
than  procurement  and  production  systems  can 
adapt.  Accordingly,  the  equipment  itself  should  be 
adaptive  whenever  possible.  I  provide  examples  of 
ways  to  incentivize  and  achieve  adaptability  and 
show  why  the  present  system  does  the  reverse.  The 
ninth  proposition  is  that  the  present  propensity  for 
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building  new  equipment  for  the  long  term  should 
be  tempered  by  greater  investments  in  less-endur¬ 
ing  equipment.  This  will  provide  greater  flexibility 
to  adapt  as  environments  change  unpredictably. 
The  tenth  proposition  outlines  the  advantages  of 
diversification  and  makes  a  case  for  inter-service 
competition  and  diversity  in  equipment  among 
U.S.  allies,  even  at  the  expense  of  presently  much¬ 
valued  “jointness”  and  concepts  of  efficiency  that 
rest  on  error-prone  predictive  premises. 

Policymakers  are  right  to  attempt  to  enhance  their 
understanding  of  the  future,  but  such  efforts  need 
to  be  complemented  with  a  better  recognition  of 
likely  failures  of  foresight.  I  recommend  schizo¬ 
phrenia:  People  must  simultaneously  predict  and 
plan  for  predictive  failure.  The  best  approach  is  not 
only  to  improve  foresight  but  also  to  supplement  it 
with  the  strategies  recommended  here  (and  others 
that  hopefully  will  be  developed).  Put  another  way, 
people  are  now  overly  dependent  on  successful 
prediction.  Correcting  this  imbalance  requires  a 
clear-eyed  recognition  of  the  problem,  challenging 
changes  in  processes,  new  incentives  and  invest¬ 
ment  in  strategies,  and  tactics  that  better  prepare 
for  predictive  failure. 


II:  HUMANITY  IS  COMPELLED  TO 
PREDICT  AND  WILL  FAIL  -  THE  FIRST 
FIVE  PROPOSITIONS 

1.  The  Propensity  to  Make  Predictions  - 
and  to  Act  on  the  Basis  of  Predictions  - 
Is  Inherently  Human 

“No  one  can  predict  the  future”  is  a  common 
saying,  but  people  quite  correctly  believe  and 
act  otherwise  in  everyday  life.  In  fact,  daily 
life  is  built  on  a  foundation  of  prediction.  One 
expects  (predicts)  that  housing,  food  and  water 
will  be  safe  and,  over  the  longer  term,  that  saved 
money  will  retain  value.  These  predictions  are 
typically  validated  by  everyday  experience.  As  a 
consequence,  people  develop  expectations  about 
prediction  and  a  taste,  even  a  hunger,  for  it.  If 
security  in  everyday  life  derives  from  predictive 
power,  it  is  natural  to  try  to  build  national  secu¬ 
rity  in  the  same  way. 

This  taste  for  prediction  has  deep  roots.16 
Humans  are  less  physically  capable  than  other 
species  but  more  adept  at  reasoning.17  Reasoning 
is  adaptive;  it  enhances  the  odds  of  survival  for 
the  species  and  of  survival,  power,  health  and 
wealth  for  individuals.  Reasoning  depends  on 
predictive  power.  If  what  was  benign  yesterday 
becomes  unpredictably  dangerous  today,  it  is 
hard  to  develop  protective  strategies,  just  as  if 
two  plus  two  equals  four  today  and  five  tomor¬ 
row,  it  is  hard  to  do  math.  Rational  thought 
depends  on  prediction  and,  at  the  same  time, 
gives  birth  to  prediction.  Humans  are  rational 
beings  and,  therefore,  make  predictions. 


The  taste  for  prediction  has  roots,  moreover,  in 
something  deeper  than  rationality.  Emotionally, 
people  are  uncomfortable  with  uncertainty18  and 
pursue  the  illusion  of  control  over  events  beyond 
their  control.  Systematic  interviews  of  those  who 
have  colostomies,  for  example,  show  that  people 
are  less  depressed  if  they  are  informed  that  their 
impaired  condition  will  be  permanent  than  if  they 
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are  told  that  it  is  uncertain  whether  they  will  be 
able  to  return  to  normal  functioning.19  Citing  this 
and  other  work,  Daniel  Gilbert  concludes  that 
“[h]uman  beings  find  uncertainty  more  painful 
than  the  things  they’re  uncertain  about.”20  An 
“illusion  of  control,”  to  employ  a  term  now  rec¬ 
ognized  in  the  literature  of  psychology,  mitigates 
the  pain  of  uncertainty.21  People  value  random 
lottery  tickets  or  poker  cards  distributed  to  them¬ 
selves  more  than  they  do  tickets  or  cards  randomly 
assigned  to  others.22  A  discomfort  with  uncertainty 
and  desire  for  control  contribute  to  an  unjustifiable 
over-reliance  on  prediction. 

2.  Requirements  for  Prediction  Will 
Consistently  Exceed  the  Ability  to  Predict 

The  literature  on  predictive  failure  is  rich  and 
compelling.23  In  the  most  systematic  assessment, 
conducted  over  15  years  ending  in  2003,  Philip 
Tetlock  asked  284  established  experts24  more 
than  27,000  questions  about  future  political  and 
economic  outcomes  (expected  electoral  results, 
likelihoods  of  coups,  accession  to  treaties,  prolifer¬ 
ation,  GDP  growth,  etc.)  and  scored  their  results.25 
Collateral  exercises  scored  predictive  achievement 
in  the  wake  of  the  breakup  of  the  Soviet  Union,  the 
transition  to  democracy  in  South  Africa  and  other 
events.  There  are  too  many  aspects  of  Tetlock ’s 
richly  textured  discussion  to  permit  a  simple 
summary,  but  his  own  rendering  of  a  central  find¬ 
ing  will  suffice  for  this  discussion:  “When  we  pit 
experts  against  minimalist  performance  bench¬ 
marks  -  dilettantes,  dart-throwing  chimps,  and 
assorted  extrapolation  algorithms  -  we  find  few 
signs  that  expertise  translates  into  greater  ability 
to  make  either  ‘well  calibrated’  or  ‘discriminating’ 
forecasts.”26 

As  described  below,27  there  are  strong  reasons 
for  a  high  likelihood  of  failure  of  foresight  when 
DOD  attempts  to  anticipate  the  requirements 
for  systems  over  future  decades.  Recent  experi¬ 
ence  makes  this  point  vividly.  Over  the  past  20 
years,28  long-term  predictions  about  the  strategic 


environment  and  associated  security  challenges 
have  been  wrong,  like  most  multi-year  predictions 
on  complex  subjects.29  It  is  simple  to  list  a  half- 
dozen  failures:30  American  defense  planners  in 
1990  did  not  anticipate  the  breakup  of  the  Soviet 
Union,  the  rapid  rise  of  China,  Japan’s  abrupt 
transition  from  decades  of  exceptional  economic 
growth  to  decades  of  no  growth,31  an  attack  like 
that  on  September  11,  2001  or  the  United  States 
invasions  of  (and  subsequent  decade-long  pres¬ 
ences  in)  Afghanistan  and  Iraq.32 

So,  in  this  light,  why  does  the  defense  community 
repeatedly  over-invest  in  prediction? 

A  common  conceptual  error  intensifies  the  hunger 
for  prediction.  History  celebrates  those  who  made 
good  predictions.  Because  Winston  Churchill’s 
fame  rests  on,  among  other  things,  his  foresight 
about  German  militarism  and  the  accuracy  of 
his  demands  for  preparation  for  World  War  II, 
it  appears  evident  that  confident  prediction  is 
the  road  to  success.  Yet  it  is  an  error  to  focus 
on  numerators  (instances  of  success)  without 
asking  about  denominators  (instances  of  fail¬ 
ure).33  Accordingly,  there  is  a  tendency  to  ignore 
Churchill’s  failures  in  many  other  predictions 
(his  disastrous  expectations  from  military  opera¬ 
tions  in  Gallipoli,  his  underestimation  of  Gandhi, 
etc.).  There  is  also  a  tendency  to  ignore  the  great 
number  of  other  predictors  who  are  not  cel¬ 
ebrated  by  history  because  they  failed  in  analogous 
circumstances. 

Moreover,  prediction  is  subject  to  refinement 
and  is  often  a  competitive  enterprise.  As  a  result, 
predictive  power  is  like  wealth  -  gaining  some  of 
it  rarely  satisfies  the  needs  of  those  who  receive  it. 
Predictive  power  intensifies  the  demand  for  more 
predictive  power. 

Tell  a  national  security  advisor  that  another 
country  is  likely  to  develop  a  nuclear  weapon,  and 
-  after  all  his  or  her  questions  have  been  answered 
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about  the  basis  of  the  prediction  -  he  or  she  will 
want  to  know  when,  in  what  numbers,  with  what 
reliability,  at  what  cost,  with  what  ability  to  deploy 
them,  to  mount  them  on  missiles,  with  what  intent 
as  to  their  use,  etc.  It  is  no  wonder  that  U.S.  intelli¬ 
gence  agencies  are  consistently  regarded  as  failing. 
Whatever  their  mixtures  of  strengths  and  weak¬ 
nesses,  they  are  always  being  pushed  to  go  beyond 
the  point  of  success. 

Put  another  way,  the  surest  prediction  about  a 
credible  prediction  is  that  it  will  induce  a  request 
for  another  prediction.  This  tendency  is  intensified 
when,  as  is  commonly  the  case,  prediction  is  com¬ 
petitive.  If  you  can  predict  the  price  of  a  product 
but  I  can  predict  it  faster  or  more  precisely,  I  gain 
an  economic  advantage.  If  I  can  better  predict  the 
success  of  troop  movements  over  difficult  terrain, 
then  I  gain  a  military  advantage.  As  a  result,  in 
competitive  situations,  my  fears  of  your  predictive 
power  will  drive  me  to  demand  more  prediction 
regardless  of  my  predictive  power.  Moreover,  your 
recognition  of  my  predictive  power  will  lead  you 
to  take  steps  to  impair  my  predictive  ability.34  Carl 
von  Clausewitz  saw  this  very  clearly:  “The  very 
nature  of  interaction  is  bound  to  make  [warfare] 
unpredictable.”35 

These  inherent  psychological  and  practical  reali¬ 
ties  will  consistently  lead  to  over-prediction.  People 
are  doomed  repeatedly  to  drive  beyond  their 
headlights. 

3.  The  Propensity  for  Prediction  Is  Especially 
Deeply  Embedded  in  the  U.S.  Department 
of  Defense 

Five  factors  powerfully  contribute  to  this 
propensity. 

BUREAUCRATIC  MANAGERS,  AND  ESPECIALLY 
GOVERNMENT  OFFICIALS,  SEEK  PREDICTABILITY 
AS  A  MEANS  OF  MAINTAINING  ORDER 

Students  of  both  business  and  government  bureau¬ 
cracies  have  observed  that  managers  seek  to 


simplify  problems  in  order  to  render  them  more 
predictable.  In  the  words  of  Herbert  Simon: 

Administrative  man  recognizes  that  the  world 
he  perceives  is  a  drastically  simplified  model  of 
the  buzzing,  blooming  confusion  that  consti¬ 
tutes  the  real  world.  He  is  content  with  the  gross 
simplification  because  he  believes  that  the  real 
world  is  mostly  empty  -  that  most  of  the  facts 
of  the  real  world  have  no  great  relevance  to  any 
particular  situation  he  is  facing  and  that  most 
significant  chains  of  causes  and  consequences 
are  short  and  simple.36 

Henry  Kissinger  arrived  at  a  similar  observation 
after  decades  of  interacting  with  U.S.  national 
security  bureaucracies.  “The  essence  of  bureau¬ 
cracy,”  he  writes,  “is  its  quest  for  safety;  its  success 
is  calculability. . .  The  attempt  to  conduct  policy 
bureaucratically  leads  to  a  quest  for  calculabil¬ 
ity  which  tends  to  become  a  prisoner  of  events.”37 
Andrew  Krepinevich,  a  long-time  observer  of 
the  Pentagon,  comments  that  bureaucrats  would 
prefer  “no  thinking  about  the  future  (which 
implies  things  might  change  and  they  might  have 
to  change  along  with  it).  To  the  extent  they  ‘toler¬ 
ate’  such  thinking,  they  attempt  to  insure  that 
such  thinking  results  in  a  world  that  looks  very 
much  like  the  one  for  which  they  have  planned.”38 
Insofar  as  the  future  is  forecast  to  differ  from  the 
present,  it  is  highly  desirable  from  a  bureaucratic 
perspective  for  the  forecast  to  at  least  be  pre¬ 
sented  with  certitude.  James  C.  Scott  discerns  the 
reasons  for  this,  arguing  that  for  a  government 
bureaucrat, 

[t]he  . . .  present  is  the  platform  for  launching  plans 
for  a  better  future. . .  The  strategic  choice  of  the 
future  is  freighted  with  consequences.  To  the  degree 
that  the  future  is  known  and  achievable  . . .  the  less 
future  benefits  are  discounted  for  uncertainty.39 

Conceding  uncertainty  would  weaken  budgetary 
claims,  power  and  status.  Moreover,  bureaucratic 
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actors  who  question  alleged  certainties  soon  learn 
that  they  are  regarded  skeptically.  Whose  team  are 
they  on?  What  bureaucratic  interest  is  served  by 
emphasizing  uncertainty? 

MILITARIES,  IN  PARTICULAR,  SEEK  PREDICTIVE 
POWER 

The  military  environment  compounds  manag¬ 
ers’  predisposition  to  prediction,  and  indeed, 
most  security  strategies  are  designed  to  reduce 
risk.  Napoleon’s  maxim  reflects  present  mili¬ 
tary  attitudes:  “To  be  defeated  is  pardonable;  to 
be  surprised  -  never!”40  The  American  military, 
committed  to  harnessing  technological  supe¬ 
riority  and  overwhelming  force,  is  particularly 
predisposed  to  a  mind-set  in  which  power  and 
predictive  accuracy  are  exaggerated.  William 
Astor  captures  the  point: 

[W]hat  disturbs  me  most  is  that  the  [U.S.] 
military  swallowed  the  Clausewitzian/German 
notion  of  war  as  a  dialectical  or  creative  art, 
one  in  which  well-trained  and  highly-moti¬ 
vated  leaders  can  impose  their  will  on  events... 
a  new  vision  of  the  battlefield  emerged  in 
which  the  U.S.  military  aimed,  without  the 
slightest  sense  of  irony,  for  “total  situational 
awareness”  and  “full  spectrum  dominance,” 
goals  that,  if  attained,  promised  command¬ 
ers  the  almost  god-like  ability  to  master  the 
“storm  of  steel,”  to  calm  the  waves,  to  com¬ 
mand  the  air.  In  the  process,  any  sense  of  war 
as  thoroughly  unpredictable  and  enormously 
wasteful  was  lost.41 

THE  MODERN  AMERICAN  MILITARY  TRACES  ITS 
ROOTS  TO  PREDICTIVE  FAILURE 

The  present  American  military  establishment  was 
created  in  the  wake  of  two  wars  -  World  War  II 
and  the  Korean  War  -  for  which  it  was  widely 
recognized  that  America  was  unprepared.42  These 
led  to  a  mantra  of  attempting  to  foresee  and 
plan  for  risks  so  as  never  again  to  be  comparably 
unprepared. 


THE  MCNAMARA  REVOLUTION  ENSHRINED 
PENTAGON  PROCESSES  DEPENDENT  ON 
PREDICTION 

A  half  century  ago,  Robert  McNamara  and  his 
“whiz  kids”  intensified  the  predictive  tendency,  but 
for  different  reasons  than  their  predecessors.  For 
McNamara  and  his  colleagues,  the  challenge  was  to 
take  an  internally  competitive,  substantially  disor¬ 
ganized  and  significantly  dysfunctional  DOD  and 
make  it  more  manageable  and  rational.  A  key  step 
to  this  end  was  to  adopt  the  then-modern  concepts 
of  strategic  planning  with  which  McNamara  had 
been  closely  associated  at  Ford  Motor  Company.43 
A  related  initiative  was  to  establish  for  DOD  a 
single  scenario  -  a  Soviet  invasion  of  Western 
Europe  -  against  which  most  investments  could  be 
measured.44  This  mechanism  of  resource  alloca¬ 
tion  became  a  mechanism  of  program  planning  in 
accord  with  the  proposition  that  “what  you  mea¬ 
sure  is  what  you  motivate.” 


The  military  environment 
compounds  managers’ 
predisposition  to  prediction. 


This  result  was  rationalized  with  the  observa¬ 
tion  that  the  Soviet  scenario  was  so  stressful  that 
all  other  contingencies  would  be  lesser  included 
cases;  they  could  be  readily  handled  with  the 
equipment,  training  and  doctrine  designed  for  the 
most  demanding  Soviet  scenario.  Of  course,  this 
scenario  was  never  as  dominant  in  practice  as  it 
was  in  theory.  Collateral  investments  were  made, 
for  example,  in  attack  submarines.  Subordinate 
combat  commands  worried  about  scenarios 
specific  to  their  regions,  such  as  fighting  in  Asia 
or  the  Persian  Gulf.  Occasional  consideration 
was  also  given  by  the  Office  of  the  Secretary  of 
Defense  to  some  alternative  opponents.45  It  was 
not  that  the  system  prohibited  collateral  thought 


13 


OCTOBER  2011 


Driving  in  the  Dark 

Ten  Propositions  About  Prediction  and  National  Security 


about  unpredicted  outcomes.  Rather,  it  forced 
overwhelming  attention  to  the  predicted  scenario 
and  offered  few  incentives  to  consider  unexpected 
contingencies. 

Owen  Brown  and  Paul  Eremenko  observe  that  the 
McNamara  revolution  introduced  a  bias  toward 
design  systems  with  long  lives  for  allegedly  predict¬ 
able  environments.  Analyzing  our  space  programs, 
they  write: 

Decisionmakers  respond  to  increased  marginal 
cost  by  . . .  increasing  lifetime  to  minimize 
amortized  annual  costs.  In  a  perfect  world  of  no 
uncertainty  (or  certainty  of  the  uncertainty)  this 
is  an  appropriate  decision.  The  scars  of  real  world 
experience  illustrate  the  true  problems  of  this 
approach.  These  space  systems,  which  (because 
of  their  complexity)  take  years  to  design  and 
build,  are  designed  to  meet  requirements  based 
on  today’s  threat  forecasts.  With  constantly 
changing  threat  environments,  requirements 
change  during  the  design  and  build  phase. 

The  result  is  redesign,  which  costs  time  and 
money  for  a  large,  tightly  coupled  system.  Once 
launched,  there  is  little  hope  the  capability  of  a 
space  system  can  be  adapted  to  a  new  threat.46 

THE  MONOLITHIC  SOVIET  OPPONENT  WAS 
UNUSUALLY  PREDICTABLE 

The  Cold  War  led  to  co-evolution:  The  mutually 
engaged  American  and  Soviet  military  systems 
responded  to  each  other’s  doctrines,  processes  and 
military  products.47  Because  the  massive  Soviet 
system  became  largely  ponderous  and  predictable,48 
the  American  system  had  unusual  opportunities 
for  forecasting.49  Furthermore,  the  U.S.  system  was 
unusually  disposed  to  produce  large  numbers  of 
standardized  systems.  The  Defense  Science  Board 
astutely  commented  on  the  result: 

Focus  was  on  long,  predictable,  evolutionary 
change  against  a  Cold  War  peer  opponent  who 
suffered  as  much,  if  not  more,  than  the  United 


States  from  a  rigid  and  bureaucratic  system. 
There  were  certainly  instances  of  adaptability 
during  the  Cold  War  period,  but  the  surviving 
features  of  that  period  are  now  predominated  by 
long  compliance-based  structures.50 

These  five  strands  combine  to  embed  a  propensity 
for  prediction  deeply  within  the  DNA  of  the  U.S. 
Department  of  Defense. 

4.  The  Unpredictability  of  Long-term  National 
Security  Challenges  Will  Always  Confound  the 
Irresistible  Forces  That  Drive  Prediction 

After  studying  the  corporate  world,  McKinsey  and 
Co.  partner  Hugh  Courtney  distinguished  four 
levels  of  uncertainty.  Courtney  usefully  observed 
that  organizations  often  simultaneously  experience 
these  different  levels  as  they  consider  diverse  deci¬ 
sions.51  At  the  first,  lowest  level,  some  strategists  can 
achieve  “a  clear  single  view  of  the  future.”52  DOD, 
for  example,  routinely  predicts  dollars  for  man¬ 
power  expenditures  over  the  next  few  months  with 
high  precision.  Accordingly,  proposals  for  increases 
in  pay  and  allowances  can  be  evaluated  with  little 
doubt  about  their  immediate  consequences. 

At  a  higher,  second  level,  uncertainty  can  be 
distilled  to  a  “limited  set  of  outcomes,  one  of 
which  will  occur.”53  For  example,  by  the  time  pres¬ 
ent  appropriations  expire,  either  a  new  military 
appropriations  bill  will  be  passed,  a  continuing 
resolution  will  extend  more  limited,  but  well- 
defined,  financing  or  no  legislative  authorizations 
will  occur.  These  three  outcomes  are,  in  Courtney’s 
terminology,  “mutually  exclusive  and  comprehen¬ 
sive  events.”54  Although  decisionmakers  cannot 
predict  with  certainty  which  of  the  alternative 
outcomes  will  prevail,  it  is  certain  that  it  will  be 
one  and  only  one  of  these  options. 

At  the  third  level,  “a  range  of  possible  future  out¬ 
comes”  can  be  identified,  although  the  outcome 
that  will  eventually  occur  is  hidden  within  that 
range.  A  Pentagon  example  might  be  that  next 
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year’s  total  budget  cannot  confidently  be  predicted 
but  a  range  of  levels  within  X  billion  dollars  can 
reasonably  be  anticipated.  In  the  fourth  and  high¬ 
est  state  of  uncertainty,  there  is  “a  limitless  range 
of  possible  future  outcomes.”55  Courtney  sugges¬ 
tively  writes  that  level-four  situations  occur  when 
foresight  is  desired  for  extended  periods  and  when 
these  periods  are  likely  to  involve  “major  tech¬ 
nological,  economic  or  social  discontinuities.”56 
RAND  Corporation  analyses  offer  a  related  insight, 
distinguishing  between  unpredictability  associ¬ 
ated  with  statistically  predictable  variables  (e.g., 
whether  a  coin  will  land  heads  or  tails)  and  “deep 
uncertainty,”  in  which  one  cannot  assuredly  weigh, 
or  perhaps  even  identify,  the  variables.57 

Pentagon  programs  to  develop  new  weapons 
systems  conform  to  Courtney’s  paradigm;  they 
have  aspects  associated  with  all  four  levels  of 
uncertainty.  Some  aspects  of  those  programs 
inevitably  depend  on  the  ability  to  foresee  environ¬ 
ments  in  which  the  weapons  will  be  used,  decades 
after  a  program  is  initiated;  these  aspects  will  be 
at  Courtney’s  fourth  level  of  uncertainty.  When 
considering  these  aspects,  decisionmakers  will 
confront  “deep  uncertainty.”  After  examining  the 
private  sector,  Courtney  concludes  that  “[ajnyone 
who  imagines  they  can  put  bounds  on  the  range  of 
potential  outcomes  in  such  [level-four]  markets  is 
engaged  in  wishful  thinking.”58 

It  is  important  to  recognize  that  the  difficulties 
inherent  in  level-four  uncertainty  do  not  result 
from  limitations  of  the  decisionmakers  or  their 
processes.  To  be  sure,  a  rich  literature  identifies 
decisionmakers’  tendencies  to  project  biases,  mis¬ 
use  heuristics,59  make  mistakes  recognizing  and 
weighing  uncertainty,60  employ  inadequate  and 
erroneous  models,  rely  on  deficient  and  distorted 
information,  resist  technological  change  because 
of  its  social  implications61  and  so  forth.62  Tetlock’s 
systematic  study  shows  repeated  failure  even  under 
level-two  uncertainty  conditions.63  Nonetheless,  at 
level  four,  errors  in  foresight  are  inevitable  due  to 


the  nature  of  the  problem,  not  simply  the  nature  of 
human  decisionmaking. 

The  number  and  diversity  of  variables  that  influ¬ 
ence  the  national  security  environment  confound 
multi-decade  forecasting.  Accurate  prediction 
would  need  to  anticipate  changes  in,  among  other 
things,  technologies,  economies,  institutions, 
domestic  and  international  politics  and,  of  course, 
the  nature  of  warfare.  Each  of  these  alone  would 
be  imponderable.  Getting  them  all  right  at  once 
is  wildly  improbable.  Worse  still,  the  evolution  of 
these  variables  is  complex  and  nonlinear.64 

Chaos  theory  uses  a  hypothesis  about  a  butterfly  to 
illustrate  the  interaction  of  variables  in  a  complex 
system.  Its  proponents  advance  the  proposition 
that  the  flapping  of  a  butterfly’s  wings  in  Indonesia 
could  initiate  a  chain  of  causation  that  would  result 
in  hurricanes  in  Florida.  However,  we  do  not  have 
to  resort  to  such  subtle  speculation  to  establish  the 
proposition  in  the  national  security  context. 

Consider  the  role,  not  of  a  butterfly,  but  of  a  but¬ 
terfly  ballot.  Specifically,  consider  the  ballot  used 
in  Florida  in  America’s  2000  presidential  election. 
Whatever  one’s  view  about  the  propriety  or  out¬ 
come  of  that  campaign,  it  is  reasonable  to  conclude 
that  the  Palm  Beach  County  ballot  was  poorly 
designed  as  a  result  of  what  came  to  be  described 
as  “the  limited  visual  acuity”  of  the  responsible 
county  official.65  It  is  generally  accepted  that  this 
resulted  in  approximately  2,000  people  inadver¬ 
tently  voting  for  Pat  Buchanan  rather  than  A1 
Gore.66  That,  in  turn,  cost  Vice  President  Gore 
an  electoral  victory  in  Florida,  which  cost  him 
the  national  election  and  led  to  the  election  of  a 
President  who  chose  to  fight  in  Iraq.  Although  the 
alternative  course  of  events  cannot  be  described 
with  certainty,  it  seems  doubtful  that  A1  Gore 
would  have  chosen  to  invade  Iraq.67  In  sum,  it  is 
quite  plausible  that  if  not  for  the  limited  visual  acu¬ 
ity  of  a  county  official  in  Florida,  the  war  in  Iraq 
would  not  have  occurred.  If  this  butterfly  ballot 
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effect  can  determine  whether  a  war  was  or  was  not 
fought,  and  that  war  itself  had  enormous  repercus¬ 
sions,  how  then  can  one  presume  to  predict  other 
wars  (and  their  consequences)  at  other  times? 

Extensive  analysis  of  the  American  stock  market 
teaches  a  similar  humility.68  No  activity  in  human 
history  has  been  so  subject  to  sustained  analysis 
and  prediction  by  so  many  intelligent  people  with 
such  substantial  resources,  such  strong  incentives 
for  success  and  such  a  cornucopia  of  information. 
Moreover,  the  actors  in  the  American  stock  market 
largely  share  the  desire  to  make  money  —  a  single, 
simple  and  well-defined  goal.  Their  progress  toward 
that  goal  is  completely  unambiguous  and  unusually 
measurable,  the  number  of  actors  is  very  large,  and 
substantial  barriers  keep  individual  participants 
from  dominating  (and  therefore  distorting)  mar¬ 
kets.  Furthermore,  in  the  American  stock  market, 
the  information  that  is  the  basis  of  prediction  is 
regulated  to  achieve  unusually  high  levels  (indeed, 
in  other  contexts,  unobtainable  levels)  of  transpar¬ 
ency,  frequency  and  regularity  of  reporting.  By 
contrast,  national  security  predictions  must  cope 
with  disguise  and  disinformation;  partial,  irregular 
and  unreliable  information;  errors  bred  by  linguistic 
and  cross-cultural  translation;  and  widely  varying 
motivations  by  idiosyncratic  actors  with  the  power 
to  produce  distorted  decisions.  Yet  even  with  all 
the  advantages  that  the  stock  market  analyst  has,  it 
has  been  amply  demonstrated  that  few  professional 
fund  managers  sustainably  beat  the  market  aver¬ 
age,  and  virtually  none  can  be  relied  on  to  do  so 
consistently.69  If  prediction  in  the  stock  market  is  so 
marked  by  failure,  how  can  one  expect  success  in 
national  security  prediction? 

Temporal  prediction  is  harder  than  substantive 
prediction.  Even  when  a  foreseen  event  is  impend¬ 
ing,  it  is  difficult  to  discern  when  a  decisive  turn 
will  take  place.  Investors  are  very  familiar  with 
this  problem.  A  description  of  the  recent  bubble  in 
American  housing  prices  details  both  how  a  handful 
of  investors  were  successful  in  predicting  a  collapse 
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and  the  difficulties  that  they  suffered  from  not  being 
able  to  predict  the  timing  of  the  market  shift.70  In 
a  more  methodical  study,  Niall  Ferguson  shrewdly 
used  changes  in  the  bond  market  on  the  eve  of 
World  War  I  as  an  indicator  of  foresight  about  the 
impending  cataclysm.  After  establishing  that  bond 
prices  did  not  fall  significantly  in  the  weeks  after 
the  assassination  of  Archduke  Ferdinand,  Ferguson 
concludes  that  “even  to  the  financially  sophisticated, 
as  far  as  can  be  judged  by  the  financial  press,  the 
First  World  War  came  as  a  surprise.”71  It  was  not 
that  the  possibility  of  war  was  unforeseen  -  to  the 
contrary,  it  was  discussed  for  decades:  “ [L] ike  an 
earthquake  on  a  densely  populated  fault  line,  its 
victims  had  long  known  that  it  was  a  possibility,  and 
how  dire  its  consequences  would  be;  but  its  tim¬ 
ing  remained  impossible  to  predict,  and  therefore 
beyond  the  realm  of  normal  risk  assessment.”72 

5.  Planning  Across  a  Range  of  Scenarios 
Is  Good  Practice  but  Will  Not  Avoid 
Predictive  Failure 

Current  Pentagon  planners  recognize  that  a  mono¬ 
lithic  scenario  can  no  longer  be  justified  (if  it  ever 
was)  and  that  a  range  of  scenarios  may  capture 
many  of  the  benefits  of  predictive  planning  while 
ameliorating  the  faults.73  The  Quadrennial  Defense 
Review,  DOD’s  primary  planning  document,  states: 

Because  America’s  adversaries  have  been  adopt¬ 
ing  a  wide  range  of  strategies  and  capabilities 
...  it  is  no  longer  appropriate  to  speak  of  “major 


regional  conflicts”  as  the  sole  or  even  the  pri¬ 
mary  template  for  sizing,  shaping,  and  evaluating 
U.S.  forces.  Rather,  U.S.  forces  must  be  prepared 
to  conduct  a  wide  variety  of  missions  under  a 
range  of  different  circumstances....  The  QDR 
thus  employed  several  scenario  combinations  to 
represent  the  range  of  likely  and/or  significant 
challenges  anticipated  in  the  future  and  tested  its 
force  capacity  against  them  . .  ,74 

The  types  of  contingencies  that  U.S.  forces  will 
actually  be  called  upon  to  conduct  in  the  future 
will  certainly  extend  beyond  the  range  of  these 
examples.  Reality  is  always  less  clear-cut  and  less 
predictable  than  our  planning  paradigms.  For 
this  reason,  DOD’s  force  planning  stresses  the 
importance  of  fielding  forces  that  are  versatile 
and  that,  in  aggregate,  can  undertake  missions 
across  the  full  range  of  plausible  challenges.75 

This  approach  reflects  thinking  that  is  more 
sophisticated  than  previous  DOD  efforts  at  predic¬ 
tion.  In  the  early  1980s,  Peter  Schwartz  and  others 
at  Shell  Oil  emphasized  that  multiple  scenarios 
could  be  more  illuminating  than  point  predic¬ 
tions.76  Well-crafted  scenarios  could  not  only 
illuminate  a  diversity  of  potential  futures,  but  their 
creation  and  discussion  could  serve  as  a  starting 
point  and  template  for  discussion,  clarifying  prem¬ 
ises  and  illuminating  the  present  world.  Moreover, 
scenarios  could  help  participants  recognize  mark¬ 
ers  indicating  that  they  were  moving  along  a 
particular  path. 

The  government  of  Singapore  has  tapped  into 
Schwartz’s  work  and  the  insights  of  some  other 
American  and  British  thinkers77  to  develop  a 
sophisticated  scenario  planning  effort,  a  “Risk 
Assessment  and  Horizon  Scanning  System”  and 
a  Centre  for  Strategic  Futures.78  Leon  Fuerth79 
and  others80  have  argued  for  broader  application 
of  this  approach  -  for  more  disciplined  efforts  at 
“foresight”81  -  in  the  operations  of  the  American 
government. 


In  the  most  technically  ambitious  efforts,  RAND 
Corporation  analysts  have  linked  scenario  devel¬ 
opment  with  computer-assisted  reasoning.82  The 
RAND  group  evaluated  scenario  techniques  as 
“tremendous  boons  to  forward-looking  strategic 
thinking,”83  but  “the  choice  of  any  small  number 
of  scenarios  to  span  a  highly  complex  future  is 
ultimately  arbitrary.”84  Furthermore,  “the  logic 
used  to  sort  the  scenarios  may  seriously  bias  any 
conclusions  drawn  from  them.”85  To  counter  this, 
their  “Long  Term  Policy  Analysis”  uses  a  software 
scenario  generator  to  create  an  “ensemble”  of 
hundreds,  thousands  or  millions  of  scenarios.  The 
ensemble  should  be  composed  of 

...  as  diverse  a  range  of  plausible  alternatives  as 
possible.  No  widely  accepted  standards  of  rigor 
for  assessing  the  quality  of  such  scenario  genera¬ 
tors  currently  exist.  However,  it  is  clear  that  such 
standards  should  be  very  different  from  those 
used  for  predictive  models.  The  ideal  scenario 
generator  would  produce  only  plausible  sce¬ 
narios,  but  in  constructing  the  software,  analysts 
should  err  on  the  side  of  including  potentially 
implausible  futures.86 

I  will  return  to  the  consideration  of  robust  and 
adaptive  decisionmaking  in  the  discussion  of 
Proposition  8,  below,  which  emphasizes  the  reward 
of  these  approaches  as  a  means  of  evaluating  adap¬ 
tivity  across  a  range  of  scenarios.  For  the  moment, 
however,  it  suffices  to  note  that  the  propagation  of 
scenarios,  however  sophisticated,  broad  ranging 
or  insightful,  does  not  obviate  the  need  for  strate¬ 
gies  for  coping  with  uncertainty.  Scenarios  provide 
some  good  ways  of  evaluating  strategies.  They  do 
not  provide  the  strategies.  The  final  propositions  in 
this  report  suggest  five  methods  by  which  perfor¬ 
mance  can  be  improved  in  the  face  of  intractable 
“deep  uncertainty.” 
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III:  HOW  TO  PREPARE  FOR 
PREDICTIVE  FAILURE  -  THE  LAST 
FIVE  PROPOSITIONS 

Despite  the  challenges  of  prediction  discussed 
above,  practical  strategies  can  improve  U.S.  secu¬ 
rity  in  the  face  of  strategic  unpredictability.  DOD 
leaders  do  need  to  make  assumptions  about  how 
the  world  works,  but  they  also  can  do  a  better  job 
of  coping  with  the  likelihood  that  many  of  their 
assumptions  will  prove  wrong. 

Although  planners  in  other  domains  confront 
comparable  problems  and  defense  analysts  can 
benefit  from  their  thinking,  the  defense  world 
is  uniquely  challenging  and  requires  special 
approaches.  For  example,  a  number  of  investors 
and  economists  have  embraced  the  premise  that 
prediction  is  a  fool’s  game  and  have  suggested 
strategies  for  proceeding  given  financial  uncer¬ 
tainty.  Many  of  these  strategies  have  lost  credibility 
because  they  led  their  proponents  (and  investors) 
to  disaster.  Yet  even  if  only  the  soundest  and  most 
modest  of  these  strategies  -  for  example,  theories 
of  investment  in  indexes,  hedging,  diversifica¬ 
tion  and  avoidance  of  very  volatile  areas  -  were 
embraced,  they  would  not  be  straightforwardly 
applicable  to  defense  expenditures.  Defense  plan¬ 
ners  cannot  rely  on  the  expectation  that  their 
political  masters  will  abstain  from  engaging  in  vol¬ 
atile  areas.  They  cannot  construct  databases  about 
armed  conflict  that  will  be  as  standardized  and 
richly  populated  as  those  relied  upon  by  quantita¬ 
tive  stock  market  modelers.  Most  fundamentally, 
investments  in  organizing,  training  and  equipping 
our  armed  forces  are  not  as  short  term,  discreet, 
rapid,  liquid,  tolerant  of  loss  or  subject  to  hedging 
as  investments  in  financial  instruments. 

Each  year,  DOD  buys  a  very  limited  number  of 
tanks,  fighter  aircraft,  destroyers  and  compa¬ 
rable  equipment  for  delivery  some  years  in  the 
future.87  Typically,  it  anticipates  using  them  for 
at  least  20  years.  These  investments  produce 


more  or  less  only  one  Army,  one  Air  Force,  one 
Marine  Corps  and  one  Navy,  although  these 
organizations  are  interconnected.  DOD  can¬ 
not  skip  some  of  these  components  (leaving  our 
troops,  for  example,  without  aircraft  and  ships 
to  transport  and  protect  them).  Nor  can  they  act 
like  capital  markets,  investing  in  a  hundred  dif¬ 
ferent  versions  of  the  Navy,  Air  Force,  Army  or 
Marine  Corps,  tolerating  failure  in  some  while 
expecting  that,  on  average,  they  will  protect  us. 
As  a  result,  even  if  one  admires  the  flawed  and 
fragile  tools  for  coping  with  unpredictability 
in  financial  securities,  they  cannot  simply  be 
extrapolated  to  deal  with  the  unpredictability  of 
challenges  to  national  security. 

How  then  should  the  defense  community  proceed? 
The  first  of  my  five  recommended  complemen¬ 
tary  strategies  calls  for  dramatically  accelerating 
acquisition  decisionmaking.  Shortening  these  pro¬ 
cesses  can  diminish  the  dependence  on  long-term 
prediction.  Such  rapidity  reduces  risk  but  should 
be  complemented  by  a  “second  standby  procure¬ 
ment  process”  that  can  respond  to  unanticipated 
circumstances  by  making  decisions  at  a  speed  pro¬ 
portionate  to  the  need.  This  strategy  also  highlights 
the  desirability  of  deferring  some  decisions  to  be 
made  as  the  future  unfolds. 

The  next  strategy  outlines  opportunities  for  modi¬ 
fying  manufacturing  processes  to  better  marry 
agility  in  manufacturing  to  speed  in  procurement. 
More  adaptive  manufacturing  processes  will  per¬ 
mit  less  reliance  on  prediction.  Defense  planners 
can  then  respond  to  unanticipated  circumstances 
by  rapidly  making  new  equipment  designed  for 
those  circumstances. 

The  third  strategy  proposes  a  prioritization  of  the 
equipment  that  is  most  adaptable.  This  requires 
systems  for  evaluating  and  valuing  resilience 
across  missions  and  physical  environments  and 
also  over  time.  This  strategy  encourages  sys¬ 
tems  that  operate  as  platforms  on  which  specific 
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applications  can  be  positioned,  platforms  that 
can  be  adapted  in  the  field  and  platforms  that  are 
“leanly  designed  to  function.” 

The  fourth  strategy  recommends  the  design  of 
more  equipment  for  the  short  term.  Instead  of 
planning  for  decades  of  use,  with  elaborate  main¬ 
tenance  and  occasional  upgrades,  some  equipment 
would  be  designed  for  obsolescence  in  order  to 
liberate  resources  for  redesign. 

The  final  strategy  argues  for  diversity  and  com¬ 
petition  as  sources  of  resilience  in  the  face  of 
unpredictable  challenges.  This  runs  counter  to  the 
mantra  of  efficiency  often  pursued  in  present  DOD 
processes.  Instead,  it  urges  a  culture  of  competition 
in  which,  rather  than  attempting  to  definitively 
foresee  what  works  best,  decisionmakers  empower 
conflicting  solutions  and  embrace  survival  of  the 
fittest  as  the  future  environment  becomes  clearer. 
Real  efficiency  is  a  factor  of  the  eventual  successful 
use  of  systems,  not  an  abstract  model  that  involves 
minimizing  cost  and  duplication. 

Taken  together,  these  five  “propositions  about 
prediction”  are,  in  fact,  propositions  about  how 
to  wean  the  defense  community  away  from  rely¬ 
ing  so  heavily  on  prediction.  Put  simply,  one  can 
make  better  decisions  by  adopting  a  premise  of 
long-term  predictive  failure.  This  prescription 
contrasts  with  most  present  decisionmaking, 
which  is  premised  on  predictive  success.  It  is, 
moreover,  very  different  from  most  present  efforts 
that  strive  for  improvement  by  pursuing  more 
predictive  power. 

6.  Accelerate  Decision  Tempo  -  and  Delay 
Some  Decisions 

There  is  a  paradox  in  this  two-headed  recommen¬ 
dation.  However,  just  as  automobiles  require  first 
and  fourth  gears  -  and  even  reverse  -  for  maneu¬ 
vering  a  vehicle  in  varying  traffic  and  over  varying 
terrains,  decision  vehicles  require  diverse  tools  in 
order  to  operate  across  a  range  of  conditions.  In  a 


world  of  uncertainty,  significant  defense  acquisi¬ 
tion  is  crippled  by  procrustean  procedures  -  all 
major  programs  are  treated  similarly.88  A  sound 
recognition  of  unpredictability  should  lead  to 
much  faster  decisions  in  some  circumstances  and 
slower,  staged  decisionmaking  in  other  contexts. 

ACCELERATE  TEMPO 

In  a  world  of  unpredictability,  there  are  heavy 
penalties  for  ponderous  decisionmaking  and  slow 
execution.  This  is  primarily  a  result  of  the  fact  that 
although  prolonged  procedures  may  improve  the 
likelihood  of  hitting  a  fixed  or  predictably  moving 
target,  they  doom  decisionmakers  to  fall  behind  an 
unpredictably  moving  target.  Accordingly,  private- 
sector  managers  make  and  execute  decisions  in 
days,  weeks  or  months.  Only  in  a  minority  of  cases 
do  they  develop  products  with  schedules  extending 
beyond  two  or  three  years  because  more  extended 
development  cycles  are  understood  to  be  too 
vulnerable  to  unpredictable  evolution  (sometimes 
revolution)  in  the  market.  The  aim  is  to  reduce 
uncertainty  by  narrowing  the  time  between  the 
initiation  of  a  concept  and  its  realization. 

DOD  processes  operate  in  quite  a  differ¬ 
ent  way.  Decision  cycles  in  three  overlapping 
domains  (the  Joint  Capabilities  and  Development 
Integration  System;  the  Planning,  Programming 
and  Budgeting  System  (PPBS);  and  the  Defense 
Acquisition  System)89  are  measured  in  years.  The 
time  from  conception  to  mass  production  is  mea¬ 
sured  in  decades. 

This  over-extended  system  attracts  criticism  due 
to  issues  of  cost  and  delay  in  delivering  desired 
equipment.90  However,  the  criticism  suggested 
by  my  first  five  propositions  points  in  a  differ¬ 
ent  direction:  Delay  increases  the  likelihood 
that  an  acquisition  will  fail  because  it  increases 
dependence  on  prediction.  A  Defense  Science 
Board  study  on  the  need  for  more  adaptability  in 
defense  forces  recognizes  this  point,  saying  flatly: 
“The  lengthy  preparation  cycles  and  associated 
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enterprise  culture  and  processes  that  evolved 
over  the  past  decades  are  a  liability  within  the 
Department  of  Defense.”91 

By  narrowing  the  gap  between  system  decisions 
and  system  delivery,  increased  speed  reduces  the 
length  of  time  that  must  be  predicted.92  The  preva¬ 
lent  premise  of  predictability  enshrines  the  false 
concept  that  more  time  will  allow  more  precise 
planning  for  the  future.  Faster  decisionmaking 
and  execution  should  be  priorities  throughout 
the  defense  acquisition  system  in  order  to  reduce 
exposure  to  the  unpredictable  changes  that  will 
arise  between  the  time  of  conception  and  the  time 
of  execution. 

Although  improvements  in  pace  are  necessary, 
they  are  insufficient.  A  recognition  of  unpre¬ 
dictability  also  points  to  a  need  for  a  second 
procurement  process  to  cope  with  unpredicted 
emergencies.  The  need  for  such  a  system  is  well 
illustrated  by  the  recent,  much  discussed,  delays 
in  obtaining  Mine  Resistant  Ambush  Protected 
(MRAP)  armored  vehicles: 

From  the  summer  of  2005  until  the  spring  of 
2008,  the  IED  threat  was  responsible  for  50  to 
80  percent  of  US  fatalities  [in  Iraq]....  The  IED 
threat  evolved  over  time,  but  all  the  major  forms 
of  IEDs  were  apparent  early  on  -  by  2004  or  2005 
at  the  latest.93 

However,  the  Pentagon  would  not  act  upon  the 
request  for  MRAPS  until  late  2007.  It  took  more 
than  2  years.94 

A  study  published  by  the  National  Defense 
University  concludes  that  the  delays  in  MRAP 
procurement  are  best  explained  by  resistance  to 
MRAP  purchases.95  There  were  operational  objec¬ 
tions  (for  example,  the  higher  clearance  of  MRAPs 
made  them  less  vulnerable  to  blasts  but  also  more 
at  risk  of  tipping  over).  Even  more  fundamentally, 
“MRAPS  were  unappealing  because  they  are  useful 
for  a  limited  defensive  purpose  in  select  irregular 


warfare  campaigns  like  Iraq  and  Afghanistan 
that  military  Service  leaders  hoped  would  be 
short-lived.”96 

For  the  purposes  of  this  report,  the  issue  is  not 
the  legitimacy  of  these  objections  but  the  time  it 
took  to  resolve  them.  A  system  built  in  the  Cold 
War  could  keep  pace  with  a  largely  predictable 
Soviet  opponent  via  a  decision  cycle  measured  in 
years.  That  environment  is  gone.  An  environment 
where  surprise  is  more  prevalent  requires  more 
rapid  decisions.97  An  unnamed  “participant”  who 
defended  the  MRAP  delay  remarked: 

If  anybody  could  have  guessed  in  2003  that  we 
would  be  looking  at  the  kind  of  [high-powered, 
buried]  IEDs  that  we’re  seeing  now  in  2007,  then 
we  would  have  been  looking  at  something  much 
longer  term  as  a  solution  ....  But  who  had  the 
crystal  ball  back  then?98 

Indeed,  no  one  had,  or  could  have  had,  “the  crystal 
ball.”  Thus,  in  a  world  without  crystal  balls,  we 
need  a  new  kind  of  wizardry:  faster  decisions. 

Presently,  we  accelerate  only  as  a  reaction  when 
we  encounter  the  unexpected,  such  as  IEDs  that 
compel  the  rapid  production  of  MRAPs.  That 
acceleration  is  effective,  in  a  delayed  and  ad  hoc 
manner.  Yet  if  the  thesis  of  this  report  is  correct, 
then  planners  should  design  decision  systems  on 
the  premise  that  the  unpredicted  will  occur.  Such  a 
design  would  complement  more  deliberate,  consen¬ 
sus-oriented,  heavily  analytic  decision  processes 
with  a  second,  rapid  but  regularized,  system  that 
could  be  invoked  when  the  Secretary  of  Defense 
judged  it  to  be  warranted  as  a  result  of  urgent, 
unanticipated  requirements.99 

In  a  2008  paper,  Andrew  Krepinevich  argues  that 
“high  priority  must  be  placed  on  compressing  the 
time  it  takes  for  investments  to  create  military 
capability  that  will  enable  the  U.S.  military  to 
prevail  in  key  . . .  competitions.”100  In  a  footnote,  he 
ties  this  to  a  distinction  drawn  in  business: 
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With  the  advent  of  the  information  technologies 
revolution  and  repeated  discontinuities  in  the 
corporate  sector,  “time  pacing”  has  become  an 
increasingly  important  attribute.  As  Kathleen 
Eisenhardt  and  Shona  Brown  point  out:  “For 
most  managers,  event  pacing  constitutes  the 
familiar  and  natural  order  of  things.  Companies 
change  in  response  to  events  such  as  moves  by 
the  competition,  shifts  in  technology,  poor  finan¬ 
cial  performance,  or  new  customer  demands... 

In  contrast,  time  pacing  refers  to  creating  new 
products  or  services,  launching  new  businesses, 
or  entering  new  markets  according  to  the 
calendar.”101 

In  these  terms,  DOD  should  supplement  its 
dominant  time-based  acquisition  systems  with 
event-based  acquisition  capabilities. 

DELAY  SOME  DECISIONS 

As  a  complement  to  reducing  total  cycle  times, 
a  new  strategy  should  defer  decisions  regarding 
particular  program  characteristics  (e.g.,  software 
systems)  as  far  back  in  the  cycle  as  possible.  This 
enables  choices  to  be  made  with  the  maximum 
information  as  to  the  currency  and  maturity  of 
those  systems  and  with  the  maximum  insight  as  to 
expected  use.  Put  another  way,  this  strategy  miti¬ 
gates  unpredictability  by  pushing  choices  closer  to 
the  future. 

Private  sector  executives  understand  the  virtue 
of  this  approach.  Disney’s  Michael  Eisner  report¬ 
edly  would  find  the  latest  point  in  time  that  he 
could  make  a  decision.102  Yet  DOD  processes 
enforce  the  opposite  approach;  the  requirements, 
PPBS  and  acquisition  systems  each  demand 
great  specification  about  activities  and  environ¬ 
ments  that  cannot  be  predicted.  Uncertainties 
and  unresolved  issues  are  regarded  as  points  of 
weakness,  impeding  go/no-go  decisions,  budget¬ 
ary  accuracy,  systems  integration  and  competitive 
fairness.  These  considerations  are  not  inappropri¬ 
ate.  However,  they  feed  and  are  fed  by  incorrect 


premises  about  predictability.  As  a  result,  major 
defense  systems  are  subject  to  excessively  fre¬ 
quent,  disruptive  and  costly  changes;  they  are 
pursued  with  a  rigidity  that  ensures  they  are 
outmoded  when  delivered;  and  they  are  poorly 
adapted  to  the  circumstances  and  requirements  of 
their  actual  use. 

7.  Increase  the  Agility  of  Production  Processes 

Production  agility  is  the  capability  of  design  and 
manufacturing  systems  to  respond,  in  terms  of 
both  quantities  and  characteristics,  to  unantici¬ 
pated  needs.  Although  this  imperative  received 
some  attention  during  the  Cold  War,  the  focus 
was  overwhelmingly  on  quantity,  with  little  atten¬ 
tion  to  the  need  for  flexibility  to  modify  what  was 
produced.  Cold  War  standby  acquisition  mecha¬ 
nisms  were  designed  for  “mobilization,”103  which 
involves  conscripting  existing  assets  or  facilitat¬ 
ing  surges  of  equipment  already  being  produced. 
The  architects  of  systems  like  CRAF  (the  civilian 
reserve  air  fleet  that  reallocates  civilian  aircraft 
to  military  uses)  and  Defense  Production  Act104 
priority  rights  were  clear  about  what  they  needed. 
They  wanted  to  ensure  that  existing  industrial 
capabilities  were  preserved,  and  they  wanted 
production  augmentation  capabilities  analogous 
to  the  manpower  augmentation  capabilities  they 
had  through  conscription,  the  Reserves  and  the 
National  Guard.105 

The  implication  of  the  first  five  propositions 
is  that  21st-century  planners  face  a  further 
challenge:  to  meet  unanticipated  needs.  Can 
a  production  system  be  designed  for  adaptive¬ 
ness  in  type,  as  well  as  in  quantity?  Commercial 
production  systems  clearly  show  that  the  answer 
is  yes.  Automobile  plants,  specialty  steel  mills 
and  semiconductor  foundries  all  have  been 
conceived  and  constructed  to  switch  products 
rapidly  as  demands,  designs  and  technologies 
change.  Defense  production  shows  little  of  this 
adaptability. 
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Helpfully,  some  programs  have  adopted  open 
systems  architecture,  modular  systems  and  spiral 
development.  They  move  toward  these  goals  by 
decoupling  parts  of  the  system,  so  it  is  possible  to 
change  subsets  of  the  system  without  changing 
the  whole.106  The  Defense  Science  Board  singles 
out  the  Navy’s  system  for  repeated  upgrading  of 
submarine  acoustic  equipment  as  path-breaking  in 
this  regard,107  but  other  examples  are  available  (the 
Board  also  commends  the  Air  Force’s  F-16  modu¬ 
lar  upgrade  program  and  the  Army’s  AMRAAM 
missile  system).108 

The  Defense  Advanced  Research  Projects 
Agency  (DARPA)  is  developing  programs  that  go 
further  by  re-conceptualizing  not  only  products 
but  also  manufacturing  processes.  As  one  prong 
of  the  effort,  the  DARPA  Defense  Science  Office 
focused  on  the  problem  of  vaccine  prepara¬ 
tion  against  unpredictable  requirements.  Even 
vaccine  variants  for  recurring  diseases  like  flu 
require  such  long  lead  times  for  seasonal  adap¬ 
tations  that  the  resulting  vaccines  are  typically 
mismatched  to  the  need.  Worse,  wholly  new 
vaccines  take  decades  to  develop,  whereas  new 
diseases  like  SARS  or  H5N1  can  reach  pandemic 
levels  within  a  year  of  being  recognized.  The 
resulting  program  has  demonstrated  that  within 
16  weeks,  it  can  produce  a  million  units  of  a 
capable  vaccine  against  a  previously  unknown 
virus.  The  key  is  to  invest  in  “scaffolds”  that  can 
produce  immunizing  proteins  when  infected 
with  virus  “vectors”  tailored  to  counter  the 
identified  pathogen.109  Recent  efforts  focused  on 
countering  the  H1N1  flu  virus,110  but  because 
the  scaffolds  can  be  used  for  a  broad  range  of 
protein  production  and  achieve  high  production 
within  30  days,  they  do  not  require  pathogen 
prediction  in  order  to  be  effective.111 

Employing  different  tactics,  but  a  similar  strat¬ 
egy,  the  J.  Craig  Venter  Institute  and  its  spin-off, 
Synthetic  Genomics  Vaccines,  are  using  synthetic 
biology  to  create  genomes112  and  then  embed  them 


in  recipient  bacteria  to  produce  vaccines.  As  with 
DARPA’s  project,  the  first  priority  is  a  flu  vaccine, 
but  according  to  an  article  describing  the  process, 
“Venter  says  the  speedier  DNA  synthesis  technique 
could  also  make  it  possible  to  keep  up  with  even 
more  rapidly  evolving  pathogens  that  change  too 
fast  for  conventional  vaccine  development  to  keep 
up.  This  includes  HIV,  malaria,  and  rhinovirus  - 
one  of  the  causes  of  the  common  cold.”113 

Working  in  a  different  domain,  DARPA’s  Tactical 
Technology  Office114  has  initiated  a  cluster  of  pro¬ 
grams  under  the  heading  “Adaptive  Vehicle  Make.” 
One  component  program,  known  as  Instant 
Foundry  Adaptive  through  Bits  (iFAB),  “looks 
to  lay  the  groundwork  for  the  development  of  a 
foundry-style  manufacturing  capability  . . .  capable 
of  rapid  reconfiguration  to  accommodate  a  wide 
range  of  design  variability  and  specifically  targeted 
at  the  fabrication  of  military  ground  vehicles.”115 

A  core  insight  of  the  Adaptive  Vehicle  Make  program 
is  that  the  manufacturing  of  complex  defense  systems 
is  slowed  by  a  lack  of  standardization  among  compo¬ 
nents  and  by  dependence  on  trial  and  error  (test  and 
retest)  as  a  means  of  integrating  these  components. 

At  the  simplest  level,  the  ideal  is  the  Lego  set,  with  its 
universal  snap-in  interface.116  However,  Lego  pieces 
need  to  be  matched  in  only  three  spatial  dimensions. 
Components  of  complex  systems  require  compat¬ 
ibility  in  many  domains  -  for  example,  they  must 
avoid  electromagnetic  interference,  be  compatible  in 
their  software  and  avoid  generating  excessive  heat 
when  operating  together.  As  this  multidimensional 
complexity  increases,  integration  becomes  more 
challenging,117  and  the  costs  and  delays  from  using 
trial  and  error  to  ascertain  system  problems  acceler¬ 
ate.118  DARPA  attempts  to  counter  this  by  building 
the  Army’s  armored  vehicles  primarily  from  compo¬ 
nents  with  standardized  interface  attributes.  It  aims 
to  reach  a  point  at  which  designers  and  foundries 
can  develop  and  manufacture  components  by  mix¬ 
ing  and  matching  parts  according  to  agreed  design 
rules,119  thereby  improving  efficiency  and  reliability.120 


For  the  purposes  of  this  report,  however,  such  work 
is  important  because,  if  achieved,  it  will  accelerate 
manufacturing  adaptiveness.121 

8.  Prioritize  Equipment  That  Is  Most  Adaptable 

To  the  extent  that  future  environments  and  tasks  are 
predictable,  one  can  make  a  strong  case  for  precisely 
defined  equipment  that  fits  a  particular  niche.  To  the 
extent  that  unpredictability  reigns,  however,  adapt¬ 
ability  is  at  a  premium.  The  F-22  is  an  example  of  a 
military  airplane  with  low  adaptability;  it  is  precisely 
designed  for  a  narrowly  defined  mission  and  will 
have  trouble  taking  on  other  roles.  At  the  other  end 
of  the  spectrum,  the  B-52  bomber  is  an  airplane 
with  high  inherent  resilience;  essentially  a  flying 
box,  it  is  used  as  a  platform  for  weapons,  communi¬ 
cations  and  missions  that  were  not,  indeed  could  not 
have  been,  envisioned  by  its  designers. 

Five  changes  would  facilitate  greater  adaptability  of 
equipment. 

First,  a  premium  should  be  placed  on  operational 
flexibility  in  requirements  processes.122  It  is  easy 
to  identify  challenging  scenarios,  like  air-to-air 
combat,  in  which  military  equipment  profits 
from  a  high  degree  of  specialization.  However, 
other  characteristics  of  the  military  environment 
should  push  toward  more  resilience  -  toward  more 
weapon  systems  like  B-52s  and  fewer  like  F-22s. 
Military  equipment  takes  longer  to  develop  and 
stays  in  service  longer  than  private  equipment, 
such  as  automobiles.  It  will  also  be  used  under  a 
much  greater  variety  of  circumstances,  many  of 
which  will  be  unpredictable. 

For  all  these  reasons,  one  would  expect  military 
systems  to  be  more  inherently  resilient  than 
civilian  systems.  In  fact,  they  are  less  so.  The 
U.S.  military  keeps  generating  systems,  like  the 
M-l  tank,  that  are  marvelous  for  defined  cir¬ 
cumstances  (e.g.,  fighting  other  tanks  on  the 
planes  of  central  Germany)  and  poor  in  their 
utility  for  other  circumstances  (e.g.,  so  heavy 


To  the  extent  that  future 
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however,  adaptability  is  at  a 
premium. 

that  they  cannot  travel  across  most  bridges  in 
the  developing  world).123 

A  major  reason  for  this  is  that  our  evaluation 
mechanisms  put  a  premium  on  performance 
in  specified  scenarios  and  no  value  on  inher¬ 
ent  resilience.124  The  evaluative  systems  now 
used  in  the  Pentagon  are  heavily  quantitative. 
Performance  payoffs  are  measured  against  agreed 
scenarios.  Yet  how  does  one  assign  quantitative 
weight  to  flexibility?  Paul  Davis  usefully  outlined 
an  approach  based  on  viewing  defense  assets  as 
a  portfolio  whose  capabilities  can  be  optimized 
against  adaptive  needs  in  a  range  of  scenarios.125 
Owen  Brown  and  Eremenko  suggest  that  one 
should  value  flexibility  analogously  to  stock 
options:  Flexibility  provides  additional  options 
for  future  action.126  They  also  recommend  the  use 
of  large  numbers  of  scenarios,  in  a  manner  analo¬ 
gous  to  that  recommended  by  RAND  (which  they 
do  not  reference),127  to  calculate  net  present  values 
with  and  without  flexibility.  These  are  good  initial 
concepts.  The  U.S.  military  needs  both  a  better 
bureaucratic  process  and  a  more  developed  sci¬ 
ence  of  decisionmaking128  to  properly  place  value 
on  flexibility  and  agility.129 


OCTOBER  2011 


Driving  in  the  Dark 

Ten  Propositions  About  Prediction  and  National  Security 


Second,  DOD  should  maximize  the  platform 
approach  suggested  by  the  B-52  example.  Using  a 
software  analogy,  the  basic  weapon  platform  is  like 
the  operating  system,  and  the  addition  and  delivery 
of  additional  focused  capabilities  is  like  the  instal¬ 
lation  and  use  of  applications.  Designing  systems 
that  provide  only  generic  sets  of  capabilities  (plat¬ 
forms),  yet  can  readily  be  customized  and  adapted 
for  particular  uses  (applications),  will  often  yield 
more  long-term  value  and  efficiency  than  develop¬ 
ing  a  system  with  a  rich  but  narrowly  focused  set 
of  capabilities  that  is  more  “efficient”  according 
to  bureaucratic,  nonop erational  and  predictively 
biased  standards.130 

Third,  resilience  over  time  is  as  important  as 
resilience  over  a  range  of  capabilities  and  condi¬ 
tions.  Evaluations  should  not  only  examine  the 
equipment  as  designed  but  also  account  for  the 
likelihood  that  this  design  will  be  modified  in 
unpredictable  ways  over  the  course  of  its  service 
life.  To  borrow  a  metaphor  from  a  related  field, 
our  systems  should,  where  possible,  be  designed  to 
operate  like  immune  systems  rather  than  for¬ 
tresses.131  The  defense  community  should  move 
away  from  designing  rigid  lines  of  defense  to  cope 
with  static  threats  and  instead  seek  capabilities  for 
adaptation  to  threats  that  cannot  be  predicted  with 
precision. 

In  general,  it  is  likely  that  this  design  orientation 
will  increase  our  reliance  on  software  rather  than 
hardware  because  software  can  more  readily  be 
adapted  or  swapped  out.132  Moreover,  the  greatest 
rewards  are  likely  to  arise  from  software  systems 
that  achieve  immediately  adaptive  responses 
without  human  intervention.  An  example  of  what 
should  be  sought  can  be  found  in  the  announce¬ 
ment  for  DARPA’s  Behavioral  Learning  for 
Adaptive  Electronic  Warfare  (BLADE)  system: 

The  goal  of  BLADE  . . .  is  to  . . .  counter  adaptive 
wireless  communication  threats  in  tactical  envi¬ 
ronments  and  in  tactically  relevant  time  scales. 


Wireless  communication  threats  include  an 
adversary’s  use  of  wireless  radios  and  networks 
for  Command,  Control,  and  Communication 
(C3),  as  well  as  for  other  malicious  uses,  such  as 
Radio  Control  Improvised  Explosive  Devices 
(RC-IED’s)  [sic]. 

Currently,  the  development  of  new  Electronic 
Attack  (EA)  techniques  requires  technicians  in  a 
laboratory  to  characterize  a  new  communication 
threat  and  then  synthesize  and  evaluate  potential 
countermeasures.  Meanwhile,  U.S.  and  allied 
forces  remain  vulnerable  to  the  new  threat  until 
the  new  countermeasure  is  fielded.  In  addition  to 
taking  a  significant  amount  of  time  to  develop, 
EA  techniques  today  are  rigidly  designed  to 
address  a  specific  threat  with  known  characteris¬ 
tics.  As  wireless  communication  devices  become 
more  adaptive  and  responsive  to  their  environ¬ 
ment  by  using  technology  such  as  Dynamic 
Spectrum  Allocation  (DSA),  the  effectiveness 
of  fixed  countermeasures  may  become  severely 
degraded. 

To  protect  U.S.  forces  and  enable  the  rapid  defeat 
of  new  communication  threats,  a  paradigm  shift 
in  Electronic  Attack  is  needed  from  a  manual 
lab-based  EA  development  approach  to  an  adap¬ 
tive  in-the-field  systems  approach.  The  BLADE 
program  will  achieve  this  objective  by  developing 
novel  algorithms  and  techniques  that  will  enable 
our  EW  systems  to  automatically  learn  to  jam 
new  RF  threats  in  the  field.133 

Fourth,  the  military  should  encourage,  plan  for 
and  facilitate  field  modification.  Army  units 
responded  to  IEDs  in  Iraq  by  soldering  additional 
armor  onto  vehicles.134  This  adaptation  follows  a 
rich  tradition.  In  World  War  II,  for  example,  when 
soldiers  in  Normandy  found  that  the  less-armored 
underbellies  of  their  tanks  were  exposed  as  they 
rode  over  hedges,  they  jury-rigged  cutting  devices 
to  take  the  tanks  through,  rather  than  over,  the 
obstacles.135  Present  policies  ignore,  and  in  some 
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ways  impede,  these  field  adaptations.  An  enlight¬ 
ened  policy  would  facilitate  them  -  for  example, 
by  deploying  armored  vehicles  with  armor  module 
attach  points  and  supplemental  componentized 
armament.136  Fighting  forces  would  thereby  be 
empowered  to  reconfigure  their  equipment  in  the 
field  to  meet  challenges  that  cannot  be  predicted. 

Fifth,  the  military  could  achieve  more  general  util¬ 
ity  by  designing  equipment  leanly.  This  approach 
would  involve  clarifying  a  desired  core  func¬ 
tion  and  designing  as  closely  as  possible  to  that 
function.  This  path  is  well  illustrated  by  the  bio¬ 
detection  conundrum  described  at  the  outset  of 
this  report.  Calls  for  a  national  strategy  to  defend 
against  bioterrorism  have  emphasized  that  detec¬ 
tion  and  surveillance  are  required  to  indicate  that 
a  pathogen  has  been  disseminated.137  Only  then 
can  we  initiate  distribution  of  drugs  that  must  be 
received  (typically  within  48  hours)  to  save  the 
lives  of  those  who  are  exposed.138  Present  aerosol 
detection  systems  determine  whether  predeter¬ 
mined  pathogens  (e.g.,  smallpox)  are  present. 

These  systems  depend,  however,  on  precise  assays 
matched  to  a  predicted  threat  list. 

The  evolution  of  modern  biology  has  produced 
techniques  of  genetic  sequencing  and  synthesis 
that  will  permit  the  modification  (and  therefore 
disguise)  of  existing  pathogens  and  the  creation 
of  new  ones.139  If  achieved,  this  will  render  our 
present  aerosol  sampling  strategies  antiquated  and 
ineffective.  Yet  instead  of  coming  to  grips  with 
this,  Department  of  Homeland  Security  (DHS) 
and  DOD  plans  for  development  of  detectors  have 
been  simply  expanding  the  number  of  pathogens 
that  must  be  assessed.  In  a  world  of  unpredictabil¬ 
ity,  they  continue  to  assume  a  world  of  continued 
predictability. 

A  strategy  for  coping  with  this  unpredictability  is 
to  make  the  detection  mechanism  synchronous 
with  the  target.  Adversaries  do  not  aim  to  contam¬ 
inate  the  environment;  they  aim  to  make  people 


sick.140  A  detection  system  that  identifies  whether 
people  are  becoming  sick  is  therefore  closely  linked 
to  the  target.  An  adversary  can  take  any  of  a  num¬ 
ber  of  unpredictable  paths  to  reach  the  target,  but 
to  be  effective,  he  or  she  must  ultimately  attack  the 
target.  Focusing  on  the  target  thus  circumvents 
the  uncertainties  about  how  the  adversary  may 
proceed. 

Over  the  next  decade,  this  lean  focus  is  technically 
feasible.  DARPA  has,  for  example,  demonstrated 
that  it  can  use  blood  samples  to  discern  virus  infec¬ 
tions  almost  immediately  after  they  occur  -  days 
before  symptoms  become  apparent.141  If  this  system 
were  employed  routinely  to  evaluate  police  and  fire 
personnel  as  they  come  off  shifts,  we  would  build 
a  known  baseline  against  which  routine  changes 
could  be  characterized  and  aberrational  changes 
immediately  recognized.  Individual  deviations 
would  be  of  little  concern,  but  if  widespread  aber¬ 
rational  infections  were  observed,  these  could  be 
correlated  with  GPS  (Global  Positioning  Systems) 
records  derived  from  squad  cars  and  fire  trucks  to 
analyze  where  infected  personnel  had  been  and, 
thereby,  which  areas  had  been  contaminated. 

This  proposition  has  immediate  significance  for 
DHS  and  the  DOD  Joint  Chemical-Biological 
Detection  Office  as  a  recommendation  for  the  allo¬ 
cation  of  their  research  and  development  funds. 
More  generally,  however,  it  is  indicative  of  a  set  of 
requirements  and  opportunities  that  arise  when 
one  recognizes  that  systems  dependent  on  predict¬ 
ability  must  be  replaced  by  new  approaches  that  are 
resilient  in  the  face  of  unpredictability.142 

9.  Build  More  for  the  Short  Term 

In  How  Buildings  Learn,  Stewart  Brand  grapples 
with  the  conundrum  that  buildings  are  usu¬ 
ally  built  for  a  particular  purpose  but  over  time 
are  put  to  uses  that  were  not  (and  frequently 
could  not  have  been)  envisioned  when  they  were 
designed.143  In  a  query  that  is  parallel  to  the  one 
in  this  report,  Brand  asks  how  an  architect  would 
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design  a  building  to  maximize  flexibility.  Among 
his  insights  is  the  observation  that  adaptive  build¬ 
ings  often  fall  into  two  different  categories,  which 
he  labels  “high  road”  and  “low  road.”  High  road 
buildings  are  built  to  endure,  elegantly  designed 
and  typically  rather  rigid.  Only  slowly  and  expen¬ 
sively  can  they  be  adapted  to  new  uses.  “Try 
putting  modern  plumbing  and  heating  into  a 
stone  [17th  century  mansion]  -  it  is  like  perform¬ 
ing  lung  surgery  on  a  tetchy  giant.  The  high  road 
is  high-visibility,  often  high-style,  nearly  always 
high  cost.”144  Low  road  buildings,  by  contrast,  are 
rapidly  constructed  for  temporary  purposes.  They 
are  inexpensive,  and  their  cheap  materials  are  easy 
to  reconfigure.  Because  no  one  puts  a  premium 
on  preserving  low  road  buildings,  they  easily  lend 
themselves  to  field  adaptation.145 

DOD’s  acquisition  process  has  been  so  focused 
on  “high  road”  sophistication  that  it  has  lost  the 
ability  to  take  Brand’s  “low  road.”  Proposition  6 
argued  that  an  accelerated  tempo  is  important  not 
only  because  slow  responses  fail  to  protect  troops 
in  immediate  danger  but  also  because  delay  pushes 
products  further  into  the  future,  where  their 
relevance  and  performance  is  less  predictable  than 
it  would  be  in  the  near  term.  This  ninth  proposi¬ 
tion  argues  that  concomitant  with  acceleration  of 
tempo,  a  healthy  recognition  of  unpredictability 
increases  the  attractions  of  shorter-life  products. 

The  private  sector  is  replete  with  short-life  prod¬ 
ucts,  ranging  from  cell  phones  and  computers 
with  expected  uses  of  a  few  years  to  automobiles 
that  typically  will  be  on  the  road  for  a  decade. 
Eighty  percent  of  DOD  procurement  consists  of 
consumables  and  short-lived  products,  but  in  its 
acquisition  of  platforms,  DOD  traditionally  com¬ 
mits  emphatically  to  long-lived  systems.  Ships  are 
built  for  30  years  (carriers  longer),  aircraft  and 
ground  vehicles  for  more  than  20  years.  In  fact, 
the  average  ship  now  in  the  U.S.  Navy  has  been 
in  service  for  more  than  20  years,  and  the  average 
airplane  almost  20  years.  This  entails  heavy  dollar 


costs  (including  maintenance  and  refurbishment), 
and  it  also  reduces  our  security.  We  are  locked  into 
outdated  equipment. 

The  rise  of  unmanned  systems  opens  opportunities 
for  a  different  procurement  emphasis  -  one  that 
accepts  expectations  of  service  periods  more  like 
those  of  computers  than  carriers.  Recognition  of 
unpredictability  in  technology  development  and 
combat  environments  would  place  a  premium  on 
this  attribute  and  begin  to  refashion  the  defense 
world  to  look  more  like  the  consumer  environ¬ 
ment.  This  approach  would  be  more  viable  if 
coupled  with  the  three  just-recommended  strate¬ 
gies  of  speed,  flexibility  and  adaptability.  The  four 
propositions  together  could  create  a  self- reinforc¬ 
ing  virtuous  cycle  that  substantially  alters  defense 
procurement,  making  it  more  resilient  and  less 
dependent  on  the  unreliable  pillar  of  prediction. 

10.  Nurture  Diversity;  Create  Competition 

The  genius  of  the  capitalist  system  is  that  it  has  no 
pretensions  about  prediction:  It  does  not  preselect 
winners  and  losers  but  instead  facilitates  competi¬ 
tion  based  on  different  premises.  The  resulting 
diversification  of  options  hedges  against  predictive 
failure:  Jones  invests  in  a  future  premised  on  A, 
Smith  invests  on  a  theory  of  not  A,  Thomas  invests 
without  reference  to  A.  At  least  one  will  be  wrong, 
but  at  least  one  will  be  right.  As  resources  are 
shifted  from  losers  to  winners,  the  system  comes 
closer  to  optimal  allocations  than  if  systemic 
predictions  were  used  for  resource  allocation. 
Market-based  systems  seem  to  be  “inefficient”  in 
that  many  resources  are  used  and  “wasted”  by  the 
losing  firms,  but  the  reality  is  that  markets  are  the 
“least  bad”  way  of  allocating  resources  because  pre¬ 
diction-based  systems  are  built  on  false  premises. 

As  indicated  in  the  introduction  to  this  report, 
it  would  initially  appear  that  the  U.S.  national 
security  establishment  could  not  operate  on  this 
premise.  One  might  think  that  the  nation  can¬ 
not  afford  either  the  economic  or  political  costs 
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of  having  multiple  armies,  navies,  air  forces  or 
marine  corps.  In  fact,  however,  we  do  have  a 
measure  of  competition  by  having  an  Army,  Navy, 
Air  Force  and  Marine  Corps.  In  recent  years,  the 
nation  has  also  put  more  emphasis  on  Special 
Operations  Forces  that  are,  in  important  respects, 
independent  of  these  services.  Also,  communi¬ 
ties  within  each  of  the  services  compete  with  one 
another  for  resources,  promotions  and  status.  This 
results  in  redundancies,  rivalries  and  inefficiencies 
that  are  often  decried.  As  a  counterforce,  a  push  for 
“jointness”  has  aimed  to  minimize  inter-service 
competition. 

Jointness  is  richly  rewarding,  and  indeed  often 
imperative,  in  many  operational  settings.  However, 
the  perspective  about  prediction  offered  here  sug¬ 
gests  that  long-term  planners  should  recognize 
limits  to  their  enthusiasm  for  central  staffs  and 
central  control.  Studying  successes  and  failures  in 
military  institutions,  Elting  Morison  concluded 
his  work  a  half-century  ago  by  stressing  the 
importance  of  “the  experimental  mood.”146  Yet  he 
recognized  that  centralization  of  power  countered 
this  essential  ingredient  for  innovation.147  That 
same  centralization  fuels  an  over-investment  in 
canonical  predictions. 

Insofar  as  the  aircraft  chosen  by  the  various 
branches  of  the  military  reflect  different  concepts 
of  warfare,  they  compete  with  one  another  and 
hedge  against  uncertain  futures.  Differing  mis¬ 
sile  defense  programs  created  a  greater  diversity  of 
opportunities  and  a  lesser  exposure  to  unpredict¬ 
able  technical  and  political  risks.  Returning  to  the 
MRAP  example,  it  is  apparent  how  the  services’ 
diverse  priorities  create  some  long-term  resiliency. 
When  the  Army  eventually  pursued  an  MRAP 
for  Iraq,  it  was  a  40,000-pound  vehicle  because 
heavy  armor  was  the  greatest  priority.  By  contrast, 
the  Marine  Corps  wanted  MRAPs  closer  to  the 
weight  of  Humvees  (16,000  pounds)  because  that 
is  what  their  helicopter  fleet  was  able  to  transport. 
Afghan  commanders  particularly  value  mobility 


and  all-terrain  attributes  not  relevant  to  Iraq.  They 
might  optimally  choose  something  in  between 
the  two  above  designs  (a  25,000-pound  MRAP?). 
However,  the  diversity  introduced  by  the  Marine 
Corps  increased  the  flexibility  and,  therefore,  resil¬ 
ience  of  the  program. 

Similarly,  although  the  diversity  of  investments 
and  system  designs  among  U.S.  allies  can  be  frus¬ 
trating,  it  can  be  rewarding  if  compatibility  can 
be  achieved.  When,  for  example,  the  United  States 
underinvested  in  naval  mine  sweeping  but  then 
very  much  wanted  such  capabilities  for  contingen¬ 
cies  in  the  Straits  of  Hormuz,  Italian  investments 
shielded  the  United  States  from  its  inability  to 
foresee  its  needs. 

The  military  should  be  willing  to  pay  for  diverse 
approaches  in  procurement.148  It  should  value  com¬ 
petition  not  just  for  reducing  prices  but  also  for 
encouraging  different  approaches  to  similar  prob¬ 
lems.  Respect  for  unpredictability  argues  against 
keeping  many  eggs  in  one  basket.  Moreover,  if 
the  U.S.  military  increases  emphasis  on  software 
elements  within  its  systems  and  facilitates  in-field 
reprogrammability  (the  eighth  proposition,  above), 
interoperability  can  be  more  readily  achieved  in 
the  future  across  services  and  across  allies. 

Effective  capitalist  competition  is  premised  on 
something  subdued  in  the  defense  context:  Starting 
more  programs  than  can  be  sustained,  comparing 
them  side  by  side,  killing  the  ones  that  are  least 
cost-effective  and  allowing  only  survival  of  the 
fittest.  This  approach  is  anathema  for  central  plan¬ 
ners.  By  definition,  it  instills  conflict.  It  requires 
starting  more  ventures  than  can  be  completed 
and,  therefore,  ensures  the  failure  of  some  ven¬ 
tures  (which  will  be  described  as  waste).  Perhaps 
worst,  such  competition  in  the  defense  world 
would  compel  senior  decisionmakers  to  judge  and 
label  failure.  However,  genuine  competition  -  a 
radical  innovation  in  the  world  of  defense  procure¬ 
ment  -  offers  the  best  probability  of  survival  in  an 
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unpredictable  world.  There  are  real  inefficiencies  to 
be  found  and  rooted  out  when  redundant  systems 
are  operated  or  proposed.  Yet  if  this  report  is  per¬ 
suasive,  great  care  should  also  be  taken  to  reveal 
whether  perceptions  of  redundancy  are  based  on 
overly  confident  predictions.  Where  that  occurs, 
it  should  be  recognized  that  what  may  be  ineffi¬ 
cient  in  a  predicted  world  may  be  life-saving  if  the 
unpredicted  occurs.  When  point  solutions  cannot 
be  confidently  predicted,  then  a  range  of  options 
must  be  nurtured,  recurrently  assessed  and  either 
sustained  or  killed  in  the  unpredictable  environ¬ 
ments  that  emerge. 


IV.  CONCLUSION 

DOD’s  systems  for  selecting  and  designing  major 
weapons  systems  rely  too  heavily  on  successful 
prediction.  Based  on  both  the  Department’s  track 
record  and  social  science  research,  we  should 
expect  frequent  error  in  decisions  premised  on 
long-term  predictions  about  the  future.  This  high 
rate  of  error  is  unavoidable.  Indeed,  it  is  inherent 
in  predictions  about  complex,  tightly  intertwined 
technological,  political  and  adversarial  activities 
and  environments  in  a  volatile  world. 

Accordingly,  we  should  balance  efforts  to  improve 
our  predictive  capabilities  with  a  strong  recogni¬ 
tion  of  the  likelihood  of  important  predictive 
failures.  We  should  identify,  improve  and  imple¬ 
ment  strategies  to  design  processes,  programs 
and  equipment  to  prepare  us  for  those  failures. 

This  report  shows  how  five  approaches  can  help: 
narrowing  dramatically  the  time  between  concep¬ 
tualizing  programs  and  bringing  them  to  fruition; 
investing  in  the  agility  of  production  processes  so 
they  can  meet  unanticipated  needs;  designing  and 
selecting  equipment  with  a  premium  on  opera¬ 
tional  flexibility;  building  more  for  the  short  term 
so  that  equipment  will  be  more  frequently  replaced, 
opening  opportunities  to  capitalize  on  emerging 
technologies;  and  valuing  diversity  and  competi¬ 
tion  in  order  to  foster  a  wider  range  of  potential 
solutions  to  currently  unknowable  problems. 

Policymakers  will  always  drive  in  the  dark. 
However,  they  must  stop  pretending  that  they  can 
see  the  road.  A  much  better  course  is  to  adopt 
techniques  to  compensate  for  unpredictable 
conditions  and,  in  so  doing,  better  prepare  us  for 
perils  that  we  will  not  have  foreseen. 
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lengthy  development  nears  completion,  changes  in  threat  definition  and  test 
scenarios  cause  systems  to  fail  Initial  Operational  Test  and  Evaluation.  The 
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93.  Christopher  J.  Lamb,  Matthew  J.  Schmidt  and  Berit  G.  Fitzsimmons, 
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97.  Written  against  the  backdrop  of  the  MRAP  controversies,  the  2010 
Quadrennial  Defense  Review  recognizes  this,  at  least  in  the  context  of  wartime 
decision-making:  "The  Department  must  not  only  prepare  for  those  threats 
we  can  anticipate,  but  also  build  the  agile,  adaptive  and  innovative  structures 
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See,  for  example,  www.acq.osd.mil/rfd/.  The  evolution  of  these  offices, 
however,  is  not  inspiring.  Viewed  as  low-cost  appendages  to  the  dominant 
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far  faster  and  more  effectively  than  it  has  been  able  to  arm  them."  Jacques 
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S.  Gansler,  The  Defense  Industry  (Cambridge,  MA:  MIT  Press,  1980),  109.  To 
the  same  effect,  see  James  Huston  "[fjollowing  its  practice  in  all  wars,  the 
United  States  on  the  eve  of  World  War  II  mobilized  troops  before  weapons  and 
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Study  on  Enhancing  the  Adaptability  ofU.S.  Military  Forces,  Part  B.  Appendices 
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are  tobacco  leaves.  "For  the  largest  program,  called  AMP  for  Accelerated 
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a  fraction  of  that  -  about  300  million  doses  of  vaccine  in  six  months . . .." 
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aspx?id=61520. 
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116.  DARPA  has  already  taken  other  steps  down  that  path.  Its  Defense 
Science  Office  reports  that  it  "has  provided  a  suite  of  armor  solutions  that 
can  be  tailored  to  meet  mission  and  vehicle-specific  weight  and  performance 
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117.  Army  combat  vehicles  must  also  operate  under  very  stressful  conditions. 
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119.  Paul  Eremenko,  "Adaptive  Vehicle  Make,"  PowerPoint  briefing  by  the 
DARPA  Tactical  Technology  Office  (August  18, 2010).  This  would  meet  a 
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provider."  Defense  Science  Board,  Enhancing  the  Adaptability  of  U.S.  Military 
Forces,  Part  B.  Appendices,  63, 67. 

120.  The  program  manager  stresses  that  because  "the  seams"  between 
components  are  presently  not  effectively  standardized,  present  modes 
of  verification  and  validation  cause  exposure  to  unpredicted  "emergent 
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designs."  Eremenko,  "Adaptive  Vehicle  Make." 

121.  The  program  manager  clearly  has  this  in  mind  as  well.  Indeed,  his  earlier 
work  on  space  vehicles  emphasized  this  priority.  See  Brown  and  Eremenko, 
"Acquiring  Space  Systems  in  an  Uncertain  Future." 
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122.  For  analogous  examples  of  policy  choices  in  domestic  matters,  see 
Donald  A.  Schon  and  Martin  Rein,  Frame  Reflection:  Toward  the  Resolution 
of  Intractable  Policy  Controversies  (New  York:  Basic  Books,  1994),  especially 
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the  platforms  themselves. 

124.  "At  present,  there  are  no  tools  provided  in  the  decision  making  process 
to  make  appropriate  trades  in  flexibility,  cost,  risk,  and  performance. . .. 
Attributes  such  as  flexibility  and  robustness,  for  which  no  commonly  accepted 
definitions  much  less  quantitative  metrics  are  available  (within  the  current 
acquisition  framework)  are  still  universally  excluded."  Brown  and  Eremenko, 
"Acquiring  Space  Systems  in  an  Uncertain  Future,"  38, 41. 

125.  Davis,  "Defense  Planning  and  Risk  Management  in  the  Presence  of  Deep 
Uncertainty." 

126.  Brown  and  Eremenko,  "Acquiring  Space  Systems  in  an  Uncertain  Future," 
40. 

127.  However,  see  the  discussion  of  Proposition  5.  See  also  the  discussion 
of  "alternative  histories"  and  Monte  Carlo  analysis  in  Taleb,  Fooled  by 
Randomness,  46-51. 

128.  "Disturbingly,  science  has  only  recently  been  able  to  handle  randomness 
(the  growth  in  available  information  has  been  exceeded  only  by  the  expansion 
of  noise.)  Probability  theory  is  a  young  arrival  in  mathematics:  probability 
applied  to  practice  is  almost  nonexistent  as  a  discipline.”  Ibid.,  xii.  Abhi 
Deshmukh  of  Purdue  University  has  been  leading  a  team  doing  promising 
work  on  this  topic  in  a  "Study  of  Flexibility"  for  the  Systems  Engineering 
Research  Corporation. 

129.  For  example,  some  field  test  trials  and  simulations  could  be  against 

a  broader  range  of  scenarios,  including  scenarios  not  specified  in  advance. 
DARPA's  Adaptive  Vehicle  Make  Program  may  make  a  contribution  in  this 
regard.  One  of  its  aims  is  to  "develop  a  quantitative  metric  of  adaptability 
associated  with  a  given  system  architecture  that  can  support  trade-offs 
between  adaptability,  complexity,  performance,  cost,  schedule,  risk,  and  other 
system  attributes."  See  "Tactical  Technology  Office:  Adaptive  Vehicle  Make 
(AVM),"  http://www.darpa.mil/AVM.aspx. 


130.  I  am  indebted  to  Mark  Ryland  for  crystallizing  the  concept  and  providing 
some  of  the  language  in  this  paragraph. 

131.  Aaron  Wildavsky  offers  this  metaphor  while  recommending  incremental 
adaptation  to  safety  risks  as  they  come  to  be  recognized  in  test  operation 
rather  than  in  advance.  Aaron  Wildavsky,  Searching  for  Safety  (New  Brunswick, 
NJ:  Transaction  Publishers,  1988). 

132.  For  example,  software-defined  radio  systems  permit  rapid  adaptation  to 
new  coding  and  modulation  standards.  The  technology  is  outlined  in  Markus 
Dillinger,  Kambiz  Madani  and  Nancy  Alonistioti,  Software  Defined  Radio: 
Architectures,  Systems  and  Functions  (West  Sussex,  England:  Wiley,  2003). 

133.  Defense  Advanced  Research  Projects  Agency,  "DARPA-BAA-10-79: 
Behavioral  Learning  for  Adaptive  Electronic  Warfare  (BLADE)"  (July  9, 2010), 
https://www.fbo.gov/index?s=opportunity&mode=form&id=0b115a25c758 
b4890f4c603016dbe6de&tab=core&_cview=0. 

134.  "As  the  IED  problem  grew  and  better  armored  vehicles  could  not 
immediately  be  fielded,  innovative  U.S.  troops  began  adding  improvised 
armor  to  their  light  Humvees.  Scrap  metal,  plywood  and  sandbags  were  used 
to  increase  protection.”  Lamb  et  al.,  "MRAPS,  Irregular  Warfare  and  Pentagon 
Reform,"  4.  Similarly,  the  Army  describes  the  jury-rigging  of  a  camera  by  field 
personnel  to  look  for  weapons  hidden  in  wells  in  Afghanistan.  A  2004  Army 
briefing  explains  that  the  device  was  developed  from  "spare  parts"  on  March 
3,  2003  and  used  effectively  to  discover  weapons,  www.army.mil/aps/06/ 
maindocument/infopapers/18.html. 

135.  Martin  Blumenson  writes: 

In  order  to  speed  up  the  movement  of  armor,  Ordnance  units  and 
tankers  throughout  the  army  had  devoted  a  great  deal  of  thought  and 
experimentation  to  find  a  device  that  would  get  tanks  through  the 
hedges  quickly  without  tilting  the  tanks  upward,  thereby  exposing  their 
underbellies  and  pointing  their  guns  helplessly  toward  the  sky.  The 
gadgets  invented  in  July  1944  were  innumerable. 

As  early  as  5  July  the  79th  Division  had  developed  a  'hedgecutter,'  which 
Ordnance  personnel  began  attaching  to  the  front  of  tanks.  Five  days  later 
the  XIX  Corps  was  demonstrating  a  'salad  fork'  arrangement,  heavy  frontal 
prongs  originally  intended  to  bore  holes  in  hedgerow  walls  to  facilitate 
placing  engineer  demolition  charges  but  accidentally  found  able  to  lift  a 
portion  of  the  hedgerow  like  a  fork  and  allow  the  tank  to  crash  through  the 
remaining  part  of  the  wall.  Men  in  the  V  Corps  invented  a  'brush  cutter'  and 
a  'green-dozer'  as  anti-hedgerow  devices. 

The  climax  of  the  inventive  efforts  was  achieved  by  a  sergeant  in  the  102d 
Cavalry  Reconnaissance  Squadron,  Curtis  G.  Culin,  Jr.,  who  welded  steel 
scrap  from  a  destroyed  enemy  roadblock  to  a  tank  to  perfect  a  hedgecutter 
with  several  tusklike  prongs,  teeth  that  pinned  down  the  tank  belly  while 
the  tank  knocked  a  hole  in  the  hedgerow  wall  by  force.  General  Bradley  and 
members  of  his  staff  who  inspected  this  hedgecutter  on  14  July  were  so 
impressed  that  Ordnance  units  on  the  Continent  were  ordered  to  produce 
the  device  in  mass,  using  scrap  metal  salvaged  from  German  underwater 
obstacles  on  the  invasion  beaches.  General  Bradley  also  sent  Col.  John 
B.  Medaris,  the  army  Ordnance  officer,  to  England  by  plane  to  get  depots 
there  to  produce  the  tusks  and  equip  tanks  with  them  and  to  arrange  for 
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transporting  to  France  by  air  additional  arc-welding  equipment  and  special  140.  For  purposes  of  this  discussion,  I  am  ignoring  attacks  on  animals  and 
welding  crews....  crops. 


The  device  was  important  in  giving  tankers  a  morale  lift,  for  the  hedgerows 
had  become  a  greater  psychological  hazard  than  their  defensive  worth 
merited. 

Named  Rhinoceros  attachments,  later  called  Rhinos,  the  teeth  were  so 
effective  in  breaching  the  hedgerows  that  tank  destroyer  and  self- 
propelled  gun  units  also  requested  them,  but  the  First  Army  Ordnance 
Section  carefully  supervised  the  program  to  make  certain  that  as  many 
tanks  as  possible  were  equipped  first."  Martin  Blumenson,  US  Army  in  World 
War  II,  European  Theater  of  Operations,  Breakout  and  Pursuit  (Washington: 
U.S.  Army  Center  of  Military  History,  1961),  205-207. 

136.  Our  response  through  attempts  at  rapid  manufacture  of  MRAPs  from 
2007  onward  is  discussed  above. 

137.  Other  detection  systems  could  provide  similar  examples.  Defenses 
against  electronic  warfare  have  historically  depended  on  compiling 
signature  libraries  in  advance  of  attack  and  then  programming  electronic 
countermeasures  to  confound  the  anticipated  signals.  Analogously, 
cyberdefenses  require  intrusion  detection  systems  that  rely  on  identifying 
attack  signatures.  Like  the  biological  detection  mechanisms  discussed  in  the 
text,  these  systems  are  on  the  cusp  of  being  defeated  by  technology  that 
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Production  Notes 

Paper  recycling  is  reprocessing  waste  paper  fibers  back  into 
a  usable  paper  product. 

Soy  ink  is  a  helpful  component  in  paper  recycling.  It  helps  in  this 
process  because  the  soy  ink  can  be  removed  more  easily  than 
regular  ink  and  can  be  taken  out  of  paper  during  the  de-inking 
process  of  recycling.  This  allows  the  recycled  paper  to  have  less 
damage  to  its  paper  fibers  and  have  a  brighter  appearance. 

The  waste  that  is  left  from  the  soy  ink  during  the  de-inking 
process  is  not  hazardous  and  it  can  be  treated  easily  through 
the  development  of  modern  processes. 
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